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Abstract 

A new construction of the Fukaya-Seidel category associated with a symplectic 
Lefschetz fibration is outlined. Applying this construction in an infinite dimensional 
case, a Fukaya-Seidel-type category is associated with a smooth three-manifold. In 
this case the construction is based on a five-dimensional gauge theory. 

1 Introduction 

This paper consists of two major parts. In the first part, based on the idea of Sei- 
del [Seilj we outline a construction of the Fukaya-Seidel category, which is associated 
with a symplectic manifold M equipped with the structure of a symplectic Lefschetz fi- 
bration. By this we mean, roughly speaking, a choice of an almost complex structure J 
and a J-holomorphic Morse function /. This construction does not rely on the notion of 
vanishing cycle but emphasizes instead the role of the antigradient flow lines of Re (e /). 
In the second part, this construction is applied in the infinite dimensional case of the com- 
plex Chern-Simons functional. The corresponding construction conjecturally associates 
a Fukaya-Seidel-type category to a smooth three-manifold. 

Our motivation originated from the suggestion to use higher dimensional gauge theory 
in studies of low dimensional manifolds as outlined in [Hay|. Namely, suppose we are 
given a construction that associates a higher dimensional manifold Wx to each lower 
dimensional manifold X from a suitable subclass and possibly equipped with an additional 
structure. The manifold Wx is assumed to be of dimension 6, 7 or 8 and endowed with 
an SU(3),G2 or Spin(7) structure, respectively. Then, by counting higher dimensional 
instantons on Wx we should obtain an invariant of X. The construction studied in |Hay| 
in detail associates to each smooth spin four-manifold the total space of its spinor bundle. 

Another construction of a similar nature associates to X 4 the total space of the 
"twisted spinor bundle" M© K 2 + T*X. Then 5pm(7)-instantons invariant along each fibre 
are solutions of the Vafa-Witten equations |VWj . while Spin (7) -instantons invariant only 
along the fibres of A+T*X can be interpreted as antigradient flow lines of a function, 
whose critical points are solutions of the Vafa-Witten equations. It turns out that these 
flow lines can be obtained from certain elliptic equations on a general five-manifold W 5 
equipped with a nonvanishing vector field by specializing to the case W = X 4 x R just 
like flow lines of the real Chern-Simons functional are obtained from the anti-self-duality 
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equations on X 4 = Y 3 x R. Specializing further to W = Y 3 x R 2 we obtain a construction 
of a Fukaya-type A^-category (this requires some extra choices) just like specialization 
of the anti-self-duality equations to T? x R 2 leads to the construction of the Fukaya 
yloo-cate gory associated with E. At this point an important distinction from the case 
of Riemann surfaces emerges. Namely, the construction involves a natural holomorphic 
function, the complex Chern-Simons functional, and this has significant implications for 
the flavour of the construction. 

Having said this though, we do not appeal in this paper to higher dimensional anti-self- 
duality equations but rather begin directly with the formulation of the five-dimensional 
gauge theory. From this perspective the most interesting theory is obtained via reduction 
to three-manifolds, where the construction of the A^-category admits a finite-dimensional 
interpretation in the framework of symplectic geometry. 

This paper is organized as follows. In Section [2] we describe the construction of the 
Fukaya-Seidel category in the finite-dimensional case. From one point of view, this con- 
struction is a generalization of a Floer theory, where generators of the homology groups are 
antigradient flow lines of the real part of a holomorphic Morse function connecting a pair 
of critical points. Then the Floer differential is obtained from pseudoholomorphic planes 
with a Hamiltonian perturbation satisfying certain asymptotic conditions (see (JT])- ^ for 
more details). 

Sections [3] and [4] are devoted to the formulation of the five- dimensional gauge theory 
and its various dimensional reductions. In Section [5] we describe applications of the 
equations obtained in the previous sections to low dimensional topology. In particular, 
one can (conjecturally) associate an integer to a five-manifold, Floer-type homology groups 
to a four-manifold and a Fukaya-Seidel-type category to a three-manifold. In dimension 
three, critical points correspond to flat G c -connections on Y, flow lines correspond to 
Vafa-Witten-type instantons onFxl and pseudoholomorphic planes correspond to "five- 
dimensional instantons" on 7 x I 2 . This should be a part of a multi-tier (extended) 
quantum field theory |Frej but we do not study this aspect in the current paper. 

The constructions described in this paper may also be useful in other settings, for in- 
stance in the context of Calabi-Yau threefolds. Here the critical points of the holomorphic 
Chern-Simons functional correspond to holomorphic vector bundles over a Calabi-Yau 
threefold Z, flow lines correspond to GVinstantons on Z x R and pseudoholomorphic 
planes correspond to Spm(7)-instantons on Z x R 2 . 

Many aspects of this paper are related to ideas of various authors. As it has been 
already mentioned above, our construction of the Fukaya-Seidel category in the finite 
dimensional case is a modification of Seidel's idea. The equation we utilize for the defi- 
nition of the structure maps in the Fukaya-Seidel Aoo-category was used in the context 
of mirror symmetry by Fan- Jarvis-Ruan |FJR] ( "Witten equation" ) in the case of quasi- 
homogeneous polynomials. The antigradient flow lines of the real part of the holomorphic 
Chern-Simons functional appeared in jKW] for the first time and were further studied by 
Witten |Witll IWit2j . Donaldson and Segal |DS] used antigradient flow lines of the real 
part of the holomorphic Chern-Simons functional in the context of Calabi-Yau threefolds. 

Acknowledgements: I thank S.Bauer, S.Donaldson, V.Pidstrygach, V.Rabinovich, 
Y.Ruan, D.Salamon and P.Seidel for helpful discussions and also B.Himpel for reading 
the draft of this paper. I acknowledge the financial support of the German Research 
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Foundation (DFG) and the hospitality of Imperial College London, where part of this 
work was carried out. 



2 Fukaya— Seidel categories of symplectic Lefschetz fi- 
brations 

In [SeilL ISei2] Seidel describes the construction of a Fukaya category associated with a 
symplectic Lefschetz fibration in terms of vanishing cycles. In the first part of this section 
we describe omitting (important) technical details an alternative approach, which does 
not rely on the notion of vanishing cycle. The rest of the section is devoted to basic 
analytic properties of the objects involved in the construction. 

2.1 Symplectic Lefschetz fibrations 

Let (M 2n ,u, A), u = dX, be an exact symplectic manifold with boundary. Choose an 
almost complex structure J such that #(-,•)= u>(-, J-) is a Riemannian metric on M. It 
is also convenient to assume that J is orthogonal with respect to g. Let / : M — > C be a 
J-holomorphic function. We assume the following properties: 

(PI) / is a proper map with finitely many non-degenerate critical points lying in pairwise 
different fibres. Moreover, locally near each critical point J is integrable. 

(P2) The boundary of M is weakly J-convex. 

(P3) Let Mq = f (zo) be a regular fiber. Then there exist compact subsets K C M\dM, 
K' C Mq x C \ 8Mq x C, and a positive number r with the following significance. 
Denote V — M\K, V = M x C \ K' . Then for each z e C there exists a 
small neighbourhood B$(z) and a fiber preserving diffeomorphism ip z such that the 
following holds: The diagram 



commutes, ipz is the identity on (M x {z }) fl V whenever z £ Bg(z), and the 
pull-back of (A, J) is (\m + r A , Jm z x -^o)- Here A = Re (izdz) is the primitive of 
the standard symplectic form uq and Iq is the standard complex structure on C. 

It is worth pointing out that properties (P[T| and (P[3]) imply that there exists R > 
such that the preimage of B C R {Q) = {\z\ > R} is contained in V. In other words, 
for any z G -Bjj(O) there exists a neighbourhood B$(z) C B^(0), and fiber preserving 
diffeomorphism ijj z : M x B$(z) — > f~~ 1 (Bs(z)) with the properties as in (P[3]). Similarly, 
there exists a neighbourhood W of dM , a neighbourhood W of 8{Mq x C) = 8Mq x C, and 
a diffeomorphism ip: W — > W such that the pull-back of (A, J) is (\m + r\ , Jm x J ). 
Here Mq is some fiber. Conversely, these two properties imply (P(3]). 
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Denote 

/ = /o + «/i, P= {/o,/i}- 
An easy computation shows that on V we have p = r -1 . In particular, this implies that 
p is bounded on M. 

The following interpretation of p will be useful in the sequel. Denote 

v = grad/o and v 1 = grad/i. 

The holomorphicity of / implies Jt>o = fi- Then the Hamiltonian vector field of /o is 
Xf = —Jv — — v\. This yields 

p(m) = |w (m)| 2 = |wi(m)| 2 . (1) 

Remark 2.1. It is interesting to notice that property (F{3]) is in fact equivalent to p 
being constant on a complement of a compact subset. Indeed, assume p is constant on 
V — M \ K. Then the identity [v , Vi] = — [X^jX^] = Xtf j^ implies that v and 
V\ commute on V . The subset M \ Crit(/) is equipped with the connection, which is 
induced by the symplectic form. Then p~ 1 vo and p~ 1 vi are the horizontal lifts of and 
J^, respectively, where (s,t) be coordinates on C = IR 2 . Hence, the connection is flat over 
V. It follows that in a flat trivialization in a neighbourhood of some zeC the symplectic 
form can be written as Um z + ^^o, where r is some function. Then r is constant, since 
r _1 = p. 

Examples of the fibrations with properties (F[T|-(P[3]) can be found in |Sei2l (19b)] (it 
is only needed to drop the restriction to the preimage of a large disc). 

Other examples can be constructed starting from symplectic Lefschetz fibrations over 
the disc it: E — » D = -Bi(O) as in [Sei2l (15a)] assuming triviality near the horizontal 
boundary |Sei2t Remark 15.2]. Indeed, first of all on an open neighbourhood of d E 
diffeomorphic to an open neighbourhood of the horizontal boundary of the trivial fibration 
E pt x D with the help of a suitable cut-off function we can deform the symplectic form 
to UEpf This is clearly no longer symplectic form on the horizontal subbundle but later 
on we will add some multiple of the standard symplectic form on D so that the resulting 
2-form will be symplectic on the total space. 

To extend E to a fibration over the whole complex plane proceed as follows. Choose 
5 > such that all critical values of ir are contained in Bi^$(0). With the help of the 
parallel transport along radial lines we obtain 

E\ z =pr*E\ sl , (2) 

where pr : Z = {1 - 6 < \z\ < 1} = Sj_ 5 x [1 - 6, 1] -)> [1 - 5, 1]. If (g, <p) denote the polar 
coordinates we can write |Sei2t (15a)] the symplectic 2-form on pr*E\ x in the form 

where k = n%(g, ip)dg + k 2 (q, (p)d<p + dR for some functions Ki,k 2 ,R G C°°([l — 5, 1] x S 1 x 
^i-<5,o) (the notation does not reflect the dependence on all variables). Choose smooth 
cut-off functions a, (3 : [1 — 5, +oo] — > [0, 1] such that 

g ge[l-5,l-f], B() = l 1 ^[l-M-f], 

i e>i-|, \o e>i-|, 
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and denote k! = Ki(a(g), cp) dg + n 2 (a(g), <p) d(p+d(/3R). This defines a connection 1-form 
on 

E\ ql x [1-5, +00) \\z\ > 1-5}. (3) 

Then for sufficiently large r > the 2-form uj r = ue 1 _ so + dn' + rp*uo is symplectic and 
equals to cue + m*uio over {1 — 5 < \z\ < 1 — y }. Hence, E\ B , Q . can be glued with (|3j) 
to obtain a fibration over the whole complex plane. By construction, this has properties 

OS-OS • 

2.2 Outline of the construction 

The purpose of this subsection is to outline the main points of the alternative construction 
of the Fukaya-Seidel A^-category. The discussion of technical details is postponed to the 
proceeding subsections. 

Let us briefly recall the basic ingredients of the Fukaya-Seidel A^-category (see [Seil, 
ISei2] for details). For the sake of simplicity we consider the ungraded version with co- 
efficients in Z/2Z ("preliminary version" in the terminology of |Sei2] ) . It is convenient 
to choose a basepoint z , which does not lie on any straight line determined by a pair of 
critical values (in particular, z is distinct from critical values). Denote by m 1; . . . ,m k 
critical points of / and put Zj = f(rrij). The indexing can be chosen such that the se- 
quence arg(;?j — zq) G (— 7T, 7r] is decreasing in j and this defines a linear order on the set 
of critical points. 

Choose a collection of paths connecting zq with each Zj missing the remaining critical 
values. Let Lj C f~ l {zo) be the vanishing cycle of rrij associated with the path connecting 
Zq and Zj. Denote by Y the ordered collection (L 1; . . . , L k ). Seidel associates to Y a directed 
Fukaya Aoo-category Lag~*(Y), whose objects are vanishing cycles Lj and morphisms are 
Floer chain complexes as follows. First recall that an Aoo-structure is a collection of maps 

fi d : hom{L jd , L jd+1 ) ® • • • <g> hom(L h ,L h ) — > hom{L h , L jd+1 ), d = 1, 2, 3, . . . 

satisfying certain quadratic relations and by the directedness we have 

(CF(L 3 ,L k ) j<k, 
hom(Lj, L k ) = < Z/2 - id j = k, 
[0 j>k. 

The Floer complex CF(Lj, L k ) is generated by the points of Lj D L k and the map fi 1 
is the Floer differential, which counts pseudoholomorphic strips such that one boundary 
component is mapped to Lj and the other component is mapped to L k . The maps [i d for 
d > 2 are defined similarly by counting pseudoholomorphic discs with d + 1 punctures 
on the boundary. The resulting A^-category Lag^(Y) depends on the choices made 
but Seidel shows that the derived category D b (Lag^(Y)) is an invariant of the Lefschetz 
fibration. 

With this understood we now give another construction of the Fukaya-Seidel A^- 
category. Pick a pair of critical points (m_, m + ) and denote 9± = arg(z ± — z ) G (— 7r, it]. 
Let 7^ be the solution of the Cauchy problem 

7^ + cos 9± v + sm6± v x = 0, 7^(0) = m G /^(zq). 
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Notice that the image of / ° 7^ : R — > C is contained in a straight line passing through 
Zq and 2±. Then the vanishing cycle L± of m± associated with the segment z z± can be 
conveniently described as 



L± = [m E f \z ) I lim nfa(t) = m±\. 

Then, if we denote 

I arg«(z_ — 2 Q ) = ± 7r £ > 0, 
the set L + fl L_ can be identified with the space of solutions of the problem 

7 + cos6> (£) vq + sin#o(£) «i = 0, lim 7ft) = m T . (5) 

Here solutions are understood to be smooth ont\ {0} and continuous at £ = 0. We call 
solutions of ([5]) broken flow lines of / connecting m_ and m + and denote by r (m_; m + ) 
the space of all solutions. Notice that for each broken antigradient flow line 7 the image 
of / ° 7 lies on the curve Z-Zqz + and / ° 7(0) = z . 

It will be convenient in the sequel to replace #0 by a smooth function 8 U , where v is 
a real parameter. The choice of the function 8 U , which is described in Subsection |2.3| in 



details, turns out to be quite important, but what we need to know at this point is that 
6 V is close to #0 for v small enough. 

Denote by Y v = r^(m_,m + ) the space of solutions of the problem 

7 + cos 6 u (t) v + smOJt) Vi = 0, lim ^{t) = m T . (6) 

t— >±oo 

We also call solutions of equations ^ broken flow lines. 

Remark 2.2. We assume that for v small enough there exists a correspondence between 
solutions of (|6| and This is discussed in detail in Appendix [Bj 

Further, notice that the Floer differential fi 1 should take broken flow lines as input 
and should return formal linear combinations of broken flow lines as output. With m± as 
above, pick additionally two solutions j± of equations (|6]). Then the role of holomorphic 
strips with boundary on L± in our framework is played by solutions of the problem 

d s u + J(d t u + cos 9 v (t)v + sm9„(t)vi) = 0, u: B% >t -> M, (7) 

/+00 
\d s u(s, t) \ ds — 0, (8) 
-oo 

lim u(s,t) = 7 T (t), lim / \d s u(s, t)\ dt = 0. (9) 

J a 

Here the limits appearing on the left hand side of @ and Q are understood in the C° (IRQ- 
topology and a < b are arbitrary. Notice that ^ is the pseudoholomorphic map equation 
with a Hamiltonian perturbation. Namely, the time-dependent Hamiltonian function here 
is lm(e- ie »Wf). 
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Notice also that it is assumed that the integral in (|8j) is convergent for all i el. For 
instance, this is the case if d s u G W k,p (M?; u*TM) with k > max{^, - — 1}. In this case, 
we have 



In particular, \d s u(s,t) \ ds tends to zero as t — > 



-oo and 



||9 s w(-,t)||h/o,i(r) < Ck,p\\d s u\\ W k, P ( HT ), 

where H T = {t > r} C IR 2 . 
similarly for t — > — oo. 

It is very instructive to see a relation between solutions of (|7])-([9) and pseudoholo- 
morphic strips as in Seidel's approach. This is outlined in AppendixjA However, instead 
of proving that such a connection indeed holds, we study equations (|7|-(|9]) directly, since 
in view of the intended applications it is important to have direct proofs of the basic 
properties (compactness, Fredholm property, transversality etc.). In this paper we prove 
compactness and Fredholm property for solutions of ([7])— (|9j) . 

Next we show how to define the map /i 2 in our framework. Let Q be a (non-compact) 
Riemann surface containing three "long necks" . By this we mean a triple of holomorphic 
embeddings 

ii,i2" {z | Re z < 0} — > Q, and 23: {z \ Rez > 0} — > Q 

with disjoint images. To be more explicit, we choose the complex plane C as a model 
for n (see Fig. [T|, where the embedding %\ is given in polar coordinates by {q,<p) i— > 
(£? 2 ^ 3 ) |(v 9 + 7r ))) f < V 9< T" an d the other two embeddings are defined similarly. The 
curves shown on the figure are of the form t ij(s,t). This is our analogue of the "pair 
of pants" surface. 




Figure 1: The domain Q with three long necks. 

Further, pick any three critical points, say mi,m 2 ,m 3 and a pair (71,72) of broken 
flow lines. More precisely, 71 and 72 are solutions of the equations 

7j + cos 0j>(t) v + sin 3 >(t) v 1 = 0, 
lira jj(t) = rrij, lim 7j (t) = m j+1 . 

r— >-+oo t— y— 00 



Here 9j >v (i) is a perturbation of the function obtained from 9o(t) by putting (0_,0 + ) = 
(aig(zj — Zq), axg(zj + i — z )). Then 1^(71,72) should be a formal linear combination of 
broken flow lines connecting mi with 777.3. Pick any such flow line, i.e., a solution of the 
problem^ 

73 + cos 03,i/(O ^0 + sin 9 3tV (t) vi = 0, 
lim 7 3 (0 = mi, lim 73 (t) = m 3 , 

t— »+oo t— >— 00 

and also choose 77 G fi 0,1 (f2) such that for j = 1,2,3 we have i*r] = |e l6,J > ( -*- ) dz provided 
[Rez\ > 1. Then the multiplicity of 73 can conjecturally be defined by counting solutions 
of the equations 

Bu + r] <S) v (u) = 0, u:Q-+M, (10) 

POO 

lim u°ij(s,t)=m (7:k (j), lim / 1 9 S o tj(s, t)) Ids — 0, j — 1,2,3, (11) 

t— >-±oo ' t— >±oo 

lim u ° iAs, t) = 7j(t) lim / \d s (u o iAs, t)) \dt = 0, j = 1,2,3. (12) 

*j a 

Here r] <g> u (w) G fi - 1 ^; m*TM), a+(l,2,3) = (1,2,1), a_(l,2,3) = (2,3,3). Moreover, 



in (12) "s — > 00" means s — > —00 for j = 1,2 and s — > +00 for j = 3; The meaning of 



"00" in (11) is similar. 

Notice that over the long necks the above equations and equations ([7]H(|9]) are of a 
similar form. 

The analogue of holomorphic discs with d + 1 punctures on the boundary involved in 
the definition of fi d are defined in a similar manner. 

Let us briefly summarize. We can conjecturally associate with (/, J) a directed A^- 
category A(f, J) as follows. The objects of A(f, J) are critical points of /. For any 
pair (m_,m + ) of critical points, denote by CF(m_,m + ) the vector space generated by 
T v (m_; m + ) and put 

{CF(m_,m + ) m_<m + , 
Z/2 ■ id 777_ = 777.+ , 

m_ > 777 + . 

For 7± G r i/ (m_;m + ) denote by A^°(7-,7+) the zero-dimensional component of the 
space {u I u solves ([7])-([9])}/R. Assuming #.M°(7_, 7+) makes sense, we can define /z 1 
by declaring 

//( T -) = ^(#A^°( 7 _,7 + ) mod 2) 7+ . 

7+ 

The maps \x d for d > 2 are defined in a similar manner and together with fi l (conjecturally) 
combine to an Aoo-structure. Clearly, A(f, J) depends on the various choices involved in 
the construction. However, as explained in [Seilj the derived category D b (A(f, J)) should 
not depend on these choices. Moreover, assume (f T , J T ), r G [0, 1] is a continuous family 
such that f T is a J T -holomorphic function, whose critical points lie in pairwise different 
fibres for all r. Then D b (A(fo, Jo)) is equivalent to D b (A(fi, J±)). 



1 Our convention is that for rn_ < m + a broken flow line goes from m + to m_ as t varies between 
-00 and +00 and therefore the asymmetry between 73 and 71,72- 
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Remark 2.3. Our main example is the complex Chern-Simons functional, which takes 
values in C/Z rather than in C. In this case, the construction outlined above does 
not immediately apply. However, we may proceed as follows. Assume that each line 
i T = {z | Re z = r mod Z} contains at most one critical value of / (possibly after 
a perturbation). Pick r such that the line l r does not contain any critical value of / 
and "cut" the cylinder C/Z along i r to obtain a holomorphic function f r with values in 
(0, 1) x IR. In other words, consider only those flow lines 7 of / for which the image of 
/ ° 7 does not intersect the line £ r . Then D b (A(f r )) does not depend on r as long as r 
varies in a connected interval I such that I x R does not contain any critical value of /. 
In this way we obtain a collection of k triangulated categories (D b (A(f rj ))) j =v which is 
well-defined up to a cyclic permutation. Here k is the number of critical values of /. 



2.3 A priori C°-estimates 

Since M is not compact, we need to show that solutions of (j7j)-(|9]) do not leave a fixed 
compact subset of M. This is proved in this subsection under an additional assumption. 



The proof of Theorem |2.5[ which is the main result of this subsection, crucially depends 
on the choice of the perturbation 9 V of the function (|4]). So we take a moment to describe 
the missing details. 

Just like in the beginning of the previous subsection fix a pair of critical points 
(m_,m + ) and put z± = f{m±). Up to a translation and a rotation we can assume 
that Zq = 0, 9± G (0,7r),Im£_ = Imz + = ( > 0. For v E (0,1) consider a smooth 



function 0„ 



which satisfies 



0u(t) 



and is monotone on the intervals 



\t\ > v- 1 + 1, 
t G l-v-\-v} 
n t G [u, v' 1 ] 

— 1,— z/" 1 ), (— v, v), and (w 



>~ l + 1). We also 

assume that 9 u (t) > for t < and that 6 v (t) < for t > 0. The graph of 9 U is shown on 
Fig. [2} 



-V" 1 -! 




v M 



Figure 2: Graph of 9 V . 
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Proposition 2.4. Suppose the closed domain G bounded by the triangle z_z$z + contains 
no critical values of f other than z±. Let Uj G (0, 1) and 7^ G r i/ .(m_,m+) be arbitrary 
sequences such that Vj — > 0. T/ien £/iere exists a subsequence jk — > 00 such that 7 Jfc 
converges in C°(R; M) and 70 = lim 7^ a solution of 



The proof of Proposition 2.4 is given in Appendix [B] The assumption that G contains 



no critical values of / other than z± is essential. If this assumption does not hold, we may 
have solutions of (|6j), such that the curve foj v is not even homotopic (relative endpoints) 



to £ = z + z U zqZ- in C \ {z%, . . . , z m } (see also Lemma B.l ). In particular, the conclusion 



of Proposition 2.4 is false in this case. To exclude such phenomena, we make the following 



additional assumption. 

(HI) Convex position of critical values. The critical values of / are in convex position, 
i.e., none of the critical values of / is contained in the convex hull of the other 
critical values. The base point zq lies in the interior of the convex hull of the critical 
values. 

Theorem 2.5. There exists a compact subset K C M \ dM such that the image of any 
solution of (m) satisfying 

lim u(s,t) = m T , lim u(s, t) = 7=c(i) (13) 

t— »±oo s— >±oo 

is contained in K . 

Proof. The proof consists of the following two steps. 

Step 1. There exists a constant R > such that for any solution u G C 2 (1R 2 ) of ^ 



and (13) we have 

\fou(s,t)\<R for all (s,t) G M 2 . 



Denote / °u — <p + iip and observe that Floer's equation for u implies the equations 
d s ip — d t ip = sin 9 u (t) p o u, d s ip + d t (p — — cos 9„(t) p o u. (14) 

Denote 

0!^) = !^ cos 6 u (t) dr -t^j, e 2 (t) = -J sin6 u (T)dT 

and notice that 0i and 02 are bounded both from above and below (in fact, Qi(t) is 
locally constant for |t| > u^ 1 + 1). This crucial property is a corollary of our particular 
choice of 9 U . 

Put 0j = sup R 0j(t), Qj = inf]R Qj(t), j = 1,2. Furthermore, choose R > so large 
that f(K) C -Br(O), where K is the compact subset in (F(3]). We claim that the following 
inequality 

sup(<p(s,t) + Qi(t)) < R + Qi (15) 

R 2 
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holds for all (s,t) G M 2 . We argue by contradiction. Indeed, assume ip(s ,t ) + Qi(t ) = 
sup(<p(s, t) + 9i(t)) > R + Qi for some (sq, to) G ^ 2 (the boundary conditions for w imply 
that the supremum must be attained at some point in IR 2 ). Then (p(sa,to) > R so that 
(tp,i>) G -Bfl(O) for all (s,i) lying in some neighbourhood {7 of (so,t ). Since p = r _1 



everywhere on / 1 (77^(0)), from (14) we obtain 

A(p = r-%(t)sm9 v (t), (s,t)eU. 
Hence, the function (p + Q% is harmonic in U and achieves its maximum at (so,io) ^ 



This contradiction proves (15) 



Inequality ( 15 ) implies in turn the estimate 

supip(s,t) <R + (Oi -© x ). 

R 2 

Arguing along similar lines one also obtains 

in£<p(8,t) > -R- (©i-©i), 

R 2 

supip(s,t) < R+ (8 2 - 2 ), inf^(s,t) > -i2 - (6 2 - 6,). 

R 2 K 2 

This finishes the proof of Step [T} 
S'fep 2. We prove the theorem. 

Let W D dM, W DdMx C, and if; : W W be as in the paragraph following (Pg). 
Observe that property (F{2]) implies that the boundary of M is Ja/ -convex, i.e., there 
exists a function /i: M — > (— oo, 0], which is plurisubharmonic in a neighbourhood of the 
boundary and dM = /i _1 (0). Choose e > so small that h is subharmonic on h~ 1 (—e, 0) 
and U' = hr\-e,0) x B R (0) C W. Denote U = t/j(U'). 

We claim that for any solution u of ^ and (13) we have u(IR 2 ) D U — 0. Indeed, 



assuming the converse, there exists z = ( s cb^o) suc h that hou(z ) = sup{hou(z) \ u(z) G 
[/}. Then for sufficiently small 5 > we can think of u as a map Bs(zq) — )■ M x C. If 
7Ti denotes the projection to the first components, the map 7i"i ° u is pseudoholomorphic. 
Moreover, h°it\°u = h°u has a local maximum at ^o, which is a contradiction. 

Thus the image of u is contained in K = / _1 (5r(0)) \ U. It remains to notice that K 
is compact. □ 

Remark 2.6. We would like to stress that other results in this paper (except those in 
Appendix |B| depend on hypothesis (hQ only through Theorem 2.5 It is quite possible 



that an a priori C°-bound can still be proved for a different choice of the perturbation 
6 V , which does not require convex position of the critical values. However at present it is 
not quite clear how to obtain such an estimate without (H[T]). 

2.4 The action functional and the energy identity 

Denote 

Wm!,m + = {7 G W^{R; M) I there exist T > and f± e W 2 ' 2 ({T, 00); T m± M) 

s.t. 7 (±t) = exp m± £ ± (t)fort>T}. 
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Then the action functional 

J( 7 ) = / 7 *A + / Im (e- im f o j(t)) dt (16) 



is well-defined as a map £F: — >• K. Indeed the first integral is convergent, since 

7*A G W /1 ' 2 (1R) c — >■ Li(R). As for the second integral, the convergence follows from the 
fact that / is a quadratic function in an appropriate coordinate chart at m±. Observe 
also, that 7 is essentailly the standard symplectic action functional with a Hamiltonian 
perturbation. 

Consider the time-dependent vector field 



gradRe (e~^ (t) /) = cos0„(t) v + sin0„(t) v x . 



A standard computation shows that gKF(£) = — J R u;(£,7 + v f )dt, where £ is a vector 
field along 7. Here we used the fact, that the symplectic gradient of f is V\ = grad/i. 
Therefore with respect to the L 2 -metric we have grad^ = J (7 + t>*). Hence, the critical 
points of the functional J are broken flow lines of / connecting m + and m_. Similarly, 
the antigradient flow lines of J can be interpreted as solutions of equations (J7|). 
Define the energy of a solution u of ([7]) by 

E(u) = -[ (\d s u\ 2 + \dtu + v l \ 2 )ds Adt = [ \d s u\ 2 dsAdt. 

Theorem 2.7 (Energy identity). Let u G C 1 (M 2 ;M) be a solution of equations (J^J) (|9j) ■ 

Then 

E(u) = S , ( 7+ )-F(7_). 

In particular, E(u) < 00. 

Proof. It is convenient to denote A(s) = u(s,t) = 7 5 (t). Pick arbitrary positive numbers 
cr and r. Using Stokes' theorem and the identity 

uj{v\d s u) = ^\m (e- w ^fo U (s,t)) 
a standard computation yields 

T <J T <J 

y y \d s u\ 2 ds Adt = J J to (d s u, d t u + v f ) ds A dt 

— <T 

r (7 a 

7* „A - / T :A + / #A - / /T T A (17) 



r t 

y Ime- !e(i) /o7,(t)rft + y Ime- i9(t) /°7-<xW^- 



With the help of equation <Q we obtain 

X(d t u) - A( 7 ±) = A(ja sM ) + A(v*(t ± )) - A(v*(tt)). 
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This in turn implies by (|9|) that 
Similarly, by (|8|) we also have 



7* A as o —>• +00. 



(31 T X — > 0, as r — > +00. 



Hence, passing in (17) first to the limit as a — > +00 and then to the limit as r — >• +00 we 
obtain the statement of the theorem. □ 



2.5 A priory C°°— estimates 

It is convenient to introduce the LP- version of the energy of a map u: 



E p( u ) = 1 [ (\9 s u\ p + \d t u + v l \ p )ds A dt. 
2 Jr 2 



In particular, E(u) = E 2 (u). 

Proposition 2.8. Let u be a solution of ^ with E p {u) < 00 for some p £ [2, 00). Th 
the following holds: 



en 



lim d s u(s, t) = 

s— »±oo 

sup \d s u\ < 00 



lim d s u(s, t) = 0; 

t— >±oo 



and 

and sup \d t u\ < 00 



(18) 
(19) 



Here both limits in (18) are understood in the C°(IR) -topology. 



Proof. We have [SaIT| p. 12] the following local estimate 



\d s u(s,t)\ 2 < — / \d s u\ 2 + cr 2 

^ r JB r {s,t) 

provided J B ^ s ^ \d s u\ 2 < h. Here the constants h, c > depend on M, J, u and / but not 
onti. Applying the estimate ||<9 s w|| L 2 (jBr(M)) < (vol(B r (s,t))) 2 p \\d s u\\ L p( Br (s,t)) we obtain 



\d s u(s,t)\ 2 < 2 \\d s u\\l P{Br{Sjt)) +cr 2 
{7Tr 2 )p 



(20) 



provided \\d s u\\ LP ( Br ( s ^ < hiw 2 anc i r < \ 

Pick an arbitrary e G (0,1) and put r = -y/e. Since by assumption ||9 s u||| p , m2 n < 

00 there exists R £ > such that \\d s u\\ 2 L p( Bl ( st ^ < provided max{|s|, \t\} > R £ . 

2 



From (20) we obtain \d s u(s,t)\ 2 < (87r p + c)e, which proves (18). 



Further, the first inequality in (19) follows immediately from (18). The second inequal- 



ity in (19) is obtained from the first one using equation ^ and the fact that 
bounded. □ 



+ 1 2 

v \ — p is 
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Corollary 2.9. Let u be a solution of ^ with E p (u) < oo for some p E [2, oo). Then 
the convergence in (13) in the C° -topology implies the convergence in the C l -topology. 



Lemma 2.10. Let Q be a bounded domain in IR 2 . For any integer k > 2 and any c\ > 

there exists Ck = c&;(ci,f2) with the following significance. For any solution u of ^ the 
following implication holds: 



sup \ d s u\ < ci 



Mlc fe (Q) < Ck- 



The proof of this lemma relies on the local properties of solutions of Floer's equation 
and can be obtained along the same lines as the proof of Lemma C.3 in [RS2J (in fact 
the argument simplifies as we do not need to consider charts with Lagrangian boundary 
conditions). We omit the details. 

Proposition 2.11. For any integer k > 2 and any C\ > there exists c k = Cfc(ci) with 
the following significance. For any solution u of ^ the following implication holds: 



sup \ d s u\ < ci 



\u\\ C k 



< c k . 



Proof. From Lemma 2.10 we obtain that there exists a constant c k such that 

IMIc fe (fi) < °k, 



(21) 



where f2 = (0,1) x (— v — 2, v + 2). This implies that estimate (21) is valid for Q 



x (— v — 2, v + 2) since equation ^ is invariant with respect to shifts in the s-variable. 
Applying Lemma 2.10 to Q — (0, 1) x (i/ + 1, v + 2) and observing that both J and v l 



depend neither on s nor on t provided t > v + 1 we obtain that estimate (21) also holds 
for = Rx [y + 1, +oo). Similarly, estimate (21) is valid for fi = Kx (— v — 1, — oo) as 
well. This clearly implies the statement of the proposition. □ 



Theorem 2.12. For any integer k > there exists a constant c k > such that for any 
solution u of ([?[),( 13 ) with E p {u) < oo for some p E [2, oo) we have 



IN|c fe (R 2 ) < Ck- 

Here constants c k depend on M, J, and f but not on u. 



Proof. It follows from Proposition 2.8 that for any solution u of ([7]) with E p {u) < oo we 
have 

||Vn|| Loo = max {sup |<9 s w|, sup|<9 t u|} < oo. 

K 2 R 2 

Since the symplectic form is exact, the bubbling phenomenon does not happen. This in 
turn implies that 

ci = sup ||Vw|| Loo < oo. 



ueM{~/- ,7+) 



The rest follows immediately from Proposition 2.11 



□ 



Corollary 2.13. For any integer k > there exists a constant c k > such that for any 
solution u of ^ we have 

ll M llc fc (R 2 ) < c k- 
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2.6 Asymptotic behaviour 

Pick any smooth curve 7: R — > M such that j(t) — > m± as t — > =1=00 and denote 

<t(7)=^( 7 ) =7 + ^(7) er( 7 *TM). (22) 

Obviously, (7(7) = if and only if 7 is a broken flow line of /. Consider the linearisation 
of a at the point 7: 

M^v^ + v/ t)Gr(fTM). 

From now on we assume that all broken flow lines of / are generic. To be more precise, 
we assume that the following hypothesis holds. 

(H2) Nondegeneracy of broken flow lines. All solutions of are nondegenerate in the 
following sense: The operator 

D 7 a: VT 1 ' 2 (7*TM) — ► L 2 ( 7 *TM) (23) 

is an isomorphism. 



Remark 2.14. It is proved in Appendix [B] that hypothesis (H[2]) holds provided the 
vanishing cycles corresponding to the segments zqz± intersect transversely in Mq. 



Similarly, pick a smooth map u: R — > M satisfying boundary conditions (13) and 
denote = d s u + J(ptu + v t (u)) G Y{u*TM). Consider the linearisation of £ at the 
point u: 

D u E(0 = V s £ + J(V* £ + V 5 «') + Vf J(^« + v% 

= V s £ + JV t £ + cos 0„ V $ uj - sin 0„ V e w + V$J{d t u) , ' " " ' 

where £ G r(M 2 ;w*TM). 

Remark 2.15. The maps a and £ can be viewed as sections of certain Banach bun- 
dles (see pp.40 and 27 for details). However this is not needed for the purposes of this 
subsection. 

It is convenient to choose a unitary trivialization \1/ of u*TM. Recall that for each 
(s, t) G M 2 the map \l/(s, t) : IR 2 ™ — > T u i s j\M is a linear isomorphism of complex Hermitian 
vector spaces, where M 2n is considered to be equipped with the standard complex structure 
and the standard symplectic form: 

Jo = f ? ~l) , Wo(£, *7) = eV 77, £, *7 e K 2 ". 



1 o y 

Also denote by ip± the restriction of \I/ to 7±. 

Remark 2.16. One such trivialization can be constructed as follows. Choose a basis 
of T m _M and trivialise 7ITM with the help of the parallel transport along j_. Then 
trivialise u*TM by doing parallel transport along the curves /?*(■) = u(-,t). 
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With the help of the trivialisations chosen above we can think of the operators D 1± a 
and -D„S as acting on vector-valued functions. More precisely, there exist matrix-valued 
functions S(s,t) and S±(t) such that 

*(s,t)(d a Z + J d£ + S(s,t)Z) =£>„£(*(*,*)£), for all £ G C°°(M 2 ; M 2n ); 

ip±(t)(fi - J S±(t)ri) = D 7± a(ip±(t)r]), for all rj G C°°(R;R 2n ). 

Explicitly, matrices S and S± are given by the relations 

*(s, t)S(s, t) = + j(V t * + V*r 4 ) + V* J(<9 t u + i;'), (25) 
Mt)S±(t) = J(V^± + V^'). (26) 

To simplify the notations, denote also by L and l± the operators representing -D U S and 
D 1± a with respect to the chosen trivialisation: 

L = d s + J d t + S(s,t), l± = f t -J S±(t). (27) 

Lemma 2.17. Assume the following holds: 

(i) S: R 2 -> M 2n (R) C°° -bounded^ 

(ii) S(s,t) converges to S±(t) in the C°(R) -topology as s — > Too; 
(tit) The operators l ± : W 1 ' 2 (R;R 2n ) -»■ L 2 (IR;IR 2n ) are invertible; 
(iv) lim sup Hc^S^s, £)|| = 0. 

s— >±oo J 

Le£ ^ be a solution of the equation D£ = 0. // £ G L p (IR 2 ;IR 2n ) /or some p G (l,+oo) ; 
i/ien i/iere exzst positive constants C and 5 such that 

\£{s,t)\ < Ce- 5lsl for all{s,t) eR 2 . 

Proof. Let £ G L P (IR 2 ; lR 2n ) be a solution of the equation D£ = 0. Since D is C°°-bounded 
and uniformly elliptic, £ belongs to W k 'P(R 2 ; R 2n ) for all k and p G (1, +oo) [Shu]. In 
particular, £ is smooth and for any s G R the function £(s, ■) belongs to W fc,2 (R; M 2n ) for 
all fc. The rest of the proof is obtained by applying similar arguments to those used in 
the proof of Lemma 2.11 in |Sal2] . For the reader's convenience we repeat the main steps 
here. 
Define 

f(s) = lj\t(8,t)\*dt. 



2 this means that S as well as all derivatives are bounded on R 2 
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Then 



+00 



-00 
+00 



= 2 J \d s £\ 2 dt+ j (t,(d a s)t)dt 

—00 —00 
+00 +00 

>2 J \ J,d t i + Si\ 2 dt-e J \i\ 2 dt 



—00 
+00 

>6 2 [ \tfdt 



—00 



= 5 2 f(s). 

Here we have used the fact that the operator J d t + S(s, t) is invertible for s > sq and 
also the following equality: 

+00 +00 +00 

(£,d t (J d s O)dt = J dtfaJod&dt- J (d t ^,Jod s Odt 



-00 

+00 



=0- J (J d 8 z + j sz,j d s z)dt 



—00 

+00 +00 
|2, 



= - / \dstfdt- J (S^d s 0dt. 

—00 —00 

The inequality f"(s) > 5 2 f(s) implies f(s) < Cie _<5 ' s '. On the other hand, there exists a 
constant C2 such that for all solutions of the equation Z)£ = we have the estimate 

A|£| 2 >-C 2 |£| 2 . 
This implies the mean value inequality 

|£(M)| 2 <^ / \i?dsdt. 

r J B r (s,t) 

Taking into account the exponential decay of / we obtain the statement of this lemma 
from the last inequality. □ 

Lemma 2.18. Assume u is a solution of (|7"|) , (p~3j) . Then there exist positive constants 
C± such that the estimates 

\\S{s, t) - S±(t) || < C ± max{ \d 8 u{s, t)\, d(u(s, *), 7±(*)) } (28) 

hold for all t and all s such that =ps > 0. 
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Proof. With the help of equations ^ and dTl) we obtain 

\*(s,t)-%u(s,t)-$g\t)<y±(j;)\ < |^(s,t)- 1 (9 t M(s,t)+^(M( S ,t))| 

+ |vI/( s ,t)-V(n( S ,t))-^ ± 1 (t)i;'(7 ± (t))| 
< C±max{\d s u(s,t)\, d(u(s,t),^±(t))} 

for some positive constants C± and for all t, s as in the statement of the Lemma. Esti- 
mate (28) then follows from formulae (25), (26), and the above inequality. □ 

Theorem 2.19 (Exponential decay). Let u be a solution of (|7"|) , ([l~3| with E p {u) < oo for 
some p G [2, oo). Then the following holds: 

(i) d s u G W k, P(R 2 ;u*TM) for all k and all p G (l,oo). In particular, Ep(u) < oo for 
all p G (1, oo). 

(ii) There exist positive constants C,5 such that the inequality 

\d s u{s,t)\ < Ce~ 5lsl 

holds for any (s,t) G M 2 . 

Proof. First observe that d s u satisfies D u T,(d s u) = since equation ^ is translation- 
invariant with respect to the s-variable. Furthermore, we claim that the operator L 
representing D U H in the triviahzation \1/ is C°°-bounded. Indeed, since u is C°°-bounded, 
so is S(s,t). Obviuosly, L is also uniformly elliptic and therefore statement (i) follows 
by M. 

To prove (ii) it is enough to prove that the matrix- valued function S(s,t) defined 
by (25) satisfies the hypotheses of Lemma 2.17, We have already showed that S(s,t) is 
C^-bounded. From Lemma 2.18 and Proposition 2.8 we obtain that hypothesis (ii) of 
Lemma 2.17| is satisfied. Furthermore, by (i) and the Sobolev embedding theorems any 
solution u of ([7]) with E p (u) < 00 satisfies 

lim sup( |V s 9 s m| + iVtC^wl ) = and sup \ Vtd t u\ < 00. 



This implies that hypothesis (Hi) of Lemma 2.17 is also satisfied. Finally, hypothesis (iv) 
is satisfied, since l± represents D 1± a in the chosen triviahzation. □ 

Corollary 2.20. Let u be a solution of ([7|) > (p!3| with E p {u) < 00 for some p G [2, 00). 
Then 



lim 

t— >±oo 



0. 



lim 



\d s u(s, i)\dt = 0, 



\d s u(s, t) \ ds 
i.e., u is a solution of ([7]) -((£])■ 

Proof. The statement follows from the Sobolev embedding theorems as explained on p. [7| 

□ 

Corollary 2.21. For any solution u of 0-Q d s u G W k ' p (R 2 ; u*TM) for all k and all 
p G [1, 00). Moreover, for each k > and p > 1 there exists a constant Ck, P independent 
of u such that 
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Proof. First observe that by Theorem 2.7 d s u belongs to L 2 (M?;u*TM) and ||<9 s w||_l2 is 
bounded by a constant independent of it. 



As already mentioned in the proof of Theorem 2.19 the matrix-valued function S(s, t) 
is C°°-bounded. Moreover, it follows from Corollary 2.13 that the corresponding bounds 
can be chosen to be independent of u. Furthermore, the operator L is uniformly elliptic 
with the corresponding constant also independent of u. For such an operator of order 1 
we have the a priori estimate 

||^lkM<C fc (||i^|| lv *-i, 3 + |^| i3 ), k>l, 

where the constant Ck does not depend on u (this is seen by examining explicit formulae 
for a parametrix of L). This implies the statement of the corollary for all k > 1 and p = 2. 
This special case implies in turn the statement of the corollary in general by the Sobolev 
embedding theorems. □ 

2.7 Compactness 

Proposition 2.22. Let u be a solution of ^ and ^ with E p {u) < oo for some p E 
[2,oo). Then there exist solutions y± of problem d5]) such that 

f" 

lim w(s, £) = 7 T (£) and lim / \d s u(s,t)\ dt — 0, 

s— »±oo 1 s— >±oo / 

where the limits on the left hand side are understood in the C° (R) -topology and a < b are 
arbitrary. 

Proof. The proof consists of the following three steps. 

Step 1. Let (3 n 6 C 1 (M; M) be an arbitrary sequence of curves such that the following 
holds: 

(i) There exists a compact subset K C M containing the images of all curves (5 n ; 

(ii) lim sup \$ n + v t \ = 0; 

(Hi) Pn{t) — > rn T as t — > ±oo uniformly with respect to n. 

Then there exists a subsequence f3 nk converging in C°(R;M) to a solution of Q. 

Recall that the function p = \vq\ 2 = |i>*| 2 is bounded. Hence, it follows from (ii) 
that the sequence /3 n is equicontinuous. By the Arzela-Ascoli theorem there exists a 
subsequence (3 nk convergent on any finite interval to some 7 G C°(R;M). Then 7 e 
C^R; M) and 7 + w* = 0. 

Furthermore, by (Hi) for any e > there exits T £ > such that for all t > T e and all 
nk we have d((3 nk (t), m_) < e. Then d(y(t),m^) = limfc-^oo d((3 nk (t), m„) < e provided 
t > T £ . Hence \mi t ^ +00 y{t) = m_ and similarly \\m t ^_ 00 y{t) = m + , i.e., 7 is a solution 
of Q. Then 



swpd(f3 nk (t),y(t)) < max<{ sup d(/3 nk (t), y(t)), 2e \ < 2e 
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provided n k is large enough. This finishes the proof of Step [T] 

Step 2. Let u be a solution of (|7| and (J8j) with E p (u) < oo for some p £ [2, oo). Then 
for any e > there exists a e > such that 

inf sup g?(w(s, t), 7(t)) < £ provided \s\ > o~ e . 

7er(m_;m + ) te R 



Assume the converse. Then there exists a sequence s n — »■ +oo such that for /3 n (t) 
w(s n , i) we have 



sup d (f3 n (t), 7 (t)) > £q for all 7 G r(m_;m + ). 



(29) 



By Theorem 2^ and Proposition 2^ the sequence (3 n satisfies the hypothesis of Step [T] 
and hence has a convergent subsequence. But this contradicts inequality (29). 



Step 3. We prove the proposition. 

Let u satisfy the hypotheses of the Proposition. Since T(m_; m + ) is discrete, by Step [2] 
the family u(s, •) converges to some j± £ T(m_;m + ) in C°(R) as s -} =Foo. The rest 
follows immediately from Proposition |2.8| □ 



Proposition 2.23. For any e > there exists T > such that for all solutions u of 
([9]) the following holds: 



(i) J \d s u\ 2 dsdt < e; 

Rx[T,+oo) 

(Hi) J \d s u\ 2 dsdt < e; 

Rx[-oo,-T] 



(m) y |(9 s u(s,t)| < e for all t >T; 

k 

(if) / |(9 s u(s,t)| cfe < £ /or a// 1 < -T. 



Proof. By Corollary 2.21 we have the inequality 



\d s u(s,t)\dsdt < C 0j i. 



This implies that for any e > and any T > there exists r £ [T, T + e 1 Co,i] such that 
the estimate holds: 



\d x u(s, t)\ ds < e. 



Arguing like in the proof of the energy identity we obtain the equality 



(30) 



J \d s u\ 2 ds dt = J(r) — J A(<9 s w(s, r)) ds, 



Ix[t,+do) 



J(r)= / (A(7 + )-A( 7 -) + Ime- !S W(/o 7+ -/o 7 ,))& 
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Pick any e > and choose T > so large that \I(t)\ < e for all r > T . Then, 
as we have shown above, there exists r G [T ,T] such that estimate (30) holds, where 
T = T + £ -1 Co,i- Hence, we obtain 

/ \d s u\ 2 dsdt< I \d s u\ 2 dsdt <\I(r)\+ A \d s (s,r)\ds < e + Ae, 
J J Jr 

Rx[T,+oo) Kx[t,+oo) 

where the constant A depends on A only. This proves estimate (i). 

Let us prove (ii). We choose T > so that (i) holds. Arguing like in the proof of 
Corollary |2.21 for T" > T we obtain the inequality 

||9 s w||v^*,p(Kx[T',+oo)) — Ck, p £, 

where the constant Ck. p does not depend on u. This in turn implies that there exists a 
constant C independent of u such that the inequality f R \d B u(s,t) \ ds < Ce holds for all 
t > T. This finishes the proof of (ii). 

The remaining inequalities are proved in a similar manner. □ 

Theorem 2.24. Let Uk G .M(7_;7 + ) be any sequence. Then there exists a subsequence 
(still denoted by Uk) and subsequences s 3 k , j = such that + s J k ,t) converges 

with its derivatives uniformly on compact subsets ofM 2 to u 1 G M.{^ 3 ~ ,7^), where 7 = 
7_, 7' = 7+. 

Proof. Denote 

d Q = iinf{d( 7 (0),5(0)) \ 1 ,5eM(m„;m+), 7 ^ s}. 
For an arbitrary sequence Uk G .M(7_;7+) put 

4 = sup{s G R I d(«fc(s,0),7_(0)) > rf }• 
Notice that by the definition of we have 

d(M fc (4,0),7_(0)) = do and d(u fc (s + 4, 0), 7-(0)) < d for all s > 0. (31) 

Since the sequence sup K 2{|d s tifc|, |^itfc|} is bounded, by |Sall| Lemma 5.2] we obtain 
that the sequence Uk(s + s\,t) has a subsequence (still denoted by the same letter) uni- 
formly converging with its derivatives to a map u 1 : M 2 — > M on compact subsets of IR 2 . 
Clearly, u 1 is a solution of <Q with E 2 (u l ) < 3 r (7+) — 3^7-)- Moreover, by Proposi- 
tion 2.23 (ii) for any e > there exists T > such that for any a, b G R, a < b we 



have 

fe b +00 

J IdgU 1 (s,t)\ ds = lira J \d s u k (s + s l k , t)\ ds < e =>- J \d s u l {s, t)\ ds < e 

a a —00 

provided t > T. This implies that condition ([8]) holds for u = u 1 . Then, by Proposi- 
tion 



2.22 we obtain that there exist 7°,7 1 G .M(m_;m + ) such that 

b 



lim u x {s,t) = 7°(t), lim / \d a v}{s, t)\ dt = 0, 

lim a 1 (s,t) = 7 1 (t), lim / \d s u\s,t)\dt = 0. 

*/ (1 
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On the other hand, from (31) we obtain that 0), 7_(0)j < d for all s > 0. Hence 



7° = 7_. 

We are done if 7 1 = 7+. If this is not the case we proceed by induction. Having 
established the existence of the sequences s k such that Uk(s + s k ,t) converges to G 
A^(7 J '~ 1 ,7 J ') for j = 1, ... ,q we choose s* < such that d(u q (s*, 0), 7 9 (0)) < d . For A; 
sufficiently large we then have d(iik(s q k + s* , 0), 7 9 (0)) < c/ . Define 

sf 1 =inf{s < 8 \ + 8* I 4MM),7 9 (0)) < d for s < o < s q k + s*}. 

Passing to a subsequence if necessary we may assume that Uk(s + s q k +1 ,t) converges to 
u q+1 G Ai( , y q ,'j q+l ) with 7 9 " 1 " 1 7^ 7 9 . This finishes the induction step. Finally, the process 
is finite, since for all q = 1, ... ,1 we must have 3 r (7 9_1 ) < 3 r (7 9 ). □ 

Corollary 2.25. The space 

M(m_;m + )= (J _M( 7 _;7 + ) 

7± S .M (m_ ;m_|. ) 

compact. 



2.8 Fredholm property 

The following result, which simplifies the arguments used in earlier versions of the preprint, 
has been communicated to the author by V. Rabinovich. 

Lemma 2.26. Let 

A = aJx)- — , x G R n 
dx a 

\a\<m 

be a uniformly elliptic C 00 -bounded differential operator of order m, where a a takes val- 
ues in the space of I x l-matrices. If A: W m ' 2 (R n ; R l ) — > L 2 (R n ;R l ) is Fredholm, then 
A: W k+m ' p (R n ; R l ) ->• W k ' p (R n ; R l ) is Fredholm for allkeR,p>l and its index depends 
neither on k nor on p. 

Proof. Following |RR2j we say that A 9 = Yl\a\<m a a( x ) ^ i s a limit operator of A if 
for some sequence g: N — > R n such that gj — > 00 we have a a (x + gj) — > a 9 a (x) uni- 
formly on all compact subsets of R n . Then by Theorem 5.6 of |RRlj (see also Theorem 2 
of [EE2]) the operators A 9 : W m ' 2 (R n ;R l ) L 2 (R n ;R l ) are invertible. Observe that A 9 
is a (pseudo) differential operator with the symbol from Hormander's class S™ . By [Bca, 
Theorem 3.2] the inverse (A 9 ) -1 is a pseudodifferential operator with the symbol from 
S^™. Hence, (A 9 )' 1 : W k - m > 2 (R n ; R l ) W k ' 2 (R n ;R l ) is bounded for any feel Ap- 
plying [RRTj Theorem 5.6] again we obtain that A: W k+m ' 2 (R n ;R l ) -> W k > 2 (R n ;R l ) is 
Fredholm for any fceM. 

For arbitrary k and p > 1 put k' = min{£; — l,k — | + |} to obtain the embed- 
dings W k *(R n ',R l ) W k '< 2 (R n ; R l ),W k+m ' p (R n ; R l ) ^ W k ' +Tn ' 2 (R n ;R l ). We claim that 
A: W k+m,p (R n ; R l ) ->• W k ' p (R n ; R l ) has a closed range. Indeed, let ( n be any sequence 
from A(W k+m ' p (R n ; R 1 )) converging to Co in W k ' p (R n ; R l ). Then ( n G A(W k ' +m > 2 (R n ; R 1 )) 
converges to Co in W k '' 2 (R n ; R l ). Hence Co = A£ for some £ e W k ' +m,2 (R n ; R l ). Since A is 
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C^-bounded uniformly elliptic operator, Co e W k,p (R n ; R l ) implies that £ G W /fc+m ' p (M n ; M') 
This proves that A(W k+m ' p (R n ;R 1 )) is closed in W k ' p (R n ; R l ). 

Furthermore, C°°-boundedness and uniform ellipticity imply that if £ G VK fc ' p (R n ;R') 
is in the kernel of A for some k and p, then £ G W /fc,p (IR n ; R') for all and p. In particular, 
for any k and p the dimension of ker(A: W k+m ' p (R n ;R l ) -> V^' p (R n ;R')) is finite and 
depends neither on /c nor on p. Moreover, applying similar arguments to the formal adjoint 
operator of A we obtain that the dimension of coker(A: W k+m ' p (R n ; R l ) ->■ W rfc ' p (M n ; R 1 )) 
is also finite and depends neither on k nor on p. □ 

In the lemma below we use the same notations as in Lemma 12.171 



Lemma 2.27. Assume that in addition to hypotheses (i)-(iii) of Lemma 2.11 the following 
holds: 

(a) For each teK the matrix JoS±{t) is symmetric; 

(b) S(s, t) converges to constant matrices H± in the C° -topology ast — )■ =poo. Moreover, 

H + = lim S+(t) = lim SL(t), H_ = lim S+(t) = lim S_(t) 

t— >— oo t— y— oo t— >+oo t— >+oo 

are symmetric matrices. 

Then L : W k+1 > P (R 2 ; R 2n ) -> W fc ' p (R 2 ; IR 2 ™) zs Fredholm for any k <E R, p > 1 and its 
index depends neither on k nor on p. 

Proof. The proof consists of the following three steps. 
Step 1. Consider the s -independent operators 

L ± = d s + J d t + S ± (t). 

Then L±: W 1 > 2 (R 2 ]R 2n ) -»■ L 2 (R 2 ;R 2n ) are invertible. 

Since l± : W /1,2 (IR; R 2n ) — » L 2 (IR; IR 2n ) are isomorphisms we have the estimates 

IMIwa.2 < C±\\l ± r)\\ L 2, for all 77 G W 1,2 (M; M 2n ). (32) 

Pick any £ G C°°(1R 2 ; IR 2 ™) with compact support and apply the Fourier transform in the 
variable s to the equation L±{rf) — C to obtain 

iafj(a,t) + J l±rj(a,t) = ((a,t). 

Observe that JqI± is a symmetric operator such that does not belong to the spectrum of 
JqI±. Hence, the above equation is solvable for any real a. Applying the inverse Fourier 
transform we obtain a solution rj of the initial equation L±{rj) = (. Moreover, with the 
help of (32) an easy computation yields the estimate 1 1*>7 J| w 1 * 2 — C±||CIU 2 - This implies 
that L± are isomorphisms. 

Step 2. Consider the operators 

K ± = d s + J d t + H± 
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with constant coefficients. Then K±: W 1 ' 2 (R 2 ;R 2n ) — y L 2 (R 2 ;R 2n ) are invertible. 
Write JqK± = —d t + J d s + JqH± and observe that the operators 

k ± = £ + H±: W 1,2 (R; R 2n ) -> L 2 (R; R 2n ) 

are isomorphisms. Indeed, any function satisfying k±T) = can be expressed through ex- 
ponential functions and therefore does not belong to W^ 1,2 (R; R 2n ). Similarly, the cokernel 
of k± is also trivial. The rest of the proof of this step is analogous to the proof of Step [l] 

Step 3. We prove the lemma. 

Clearly, any limit operator L Q = d s + Jod t + Sq(s, t) of L must be K± or 

L±= d s + J d t + S ± (t + r) = V T L±V-r, 

where V T denotes the shift operator £(t) i— y £(t + r). Since V T acts as an isomorphism on 
W k ' 2 (R 2 , R 2n ) for any k, the operator L± : W 1 ' 2 (R 2 , R 2n ) -»■ L 2 (R 2 , R 2n ) is also an isomor- 
phism. Hence, by jlUTTl Theorem 5.6] we obtain that L: W 1,2 (R 2 ,R 2n ) -»■ L 2 (M 2 ,M 2n ) is 
Fredholm. Then the statement of the lemma follows from Lemma 12.261 □ 

Theorem 2.28. For each solution u of Q-Q the map D U E: W k+1 > p (R 2 ;u*TM) -> 
W k > p (R 2 ; u*TM) is Fredholm for any k € R, p > 1 and its index depends neither on k 
nor on p. 



Proof. Clearly, it is enough to check that the matrix-valued function S(s,t) given by (25) 
satisfies the hypotheses of Lemma 2.26 The fact that (a) holds can be checked by direct 
computation using (26) and is well known [Sal2]. To see that (b) holds, observe that 
v* = v o for \t\ large enough. It follows that H± represents JVt>o = Vfi at m±. Here we 
used the fact, that J is integrable in a neighbourhood of m±. It remains to notice that 
Vf i is the Hessian of f% = Im / at m± and therefore is symmetric. □ 

To compute the index of D U T, we need some preparation. Since Ind (Z? W E) depends 
neither on k nor on p, we can put k = 1, p = 2. With an arbitrary C 1 -curve 7: R — y M 
satisfying 

lim j(t) = m T and lim j(t) = (33) 

t— >±oo t— >±oo 

we associate a pair of Lagrangian subspaces in T 7 ( )M as follows. Consider the operator 
A : C°° ( 7 *TM) -> C°° (fTM) , A£ = JV t £ + §£, 

where S is a zero-order operator, namely S£ = v t +(W^ J) 7, = cos0„(£)i>i— sin6 , J/ (t)v 
(compare with (24)). Notice that lim S = S £ End(T m± M) is the Hessian of Im / at 

' ■ t— >=foo 



m_|-. As we already observed in the proof of Theorem 2.28 JS ± is then the Hessian of 
Re / and therefore is a non-degenerate self-adjoint endomorphism with vanishing signature 
(i.e., JS ± has n positive and n negative eigenvalues). 

Denote by £ v , v £ T 7 ( )M, a solution of the Cauchy problem A£ v = 0, ^ v (0) = v and 

put 

' '' 7(0)- 



A± = { v g T 7(0) M I lim ^ v (t) = 0}. 



t— >=foo 
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Then A ± are Lagrangian subspaces. Indeed, a straightforward computation shows that 
w (£v(^), £w(£)) does not depend on t for any v, w G T 7 ( )M. Therefore, if v, w G A + , then 
cu(v, w) = since w(£ v (£),£ w (t)) vanishes at — oo. Besides, dimA + = n since the signature 
of JS + vanishes. 

Remark 2.29. If v G A^, then £ v decays exponentially fast at =poo since JS^ 1 is nondegen- 
erate and self-adjoint. Hence, the kernel of the operator A: W 1,2 ( r y*TM) — > L 2 (7*TM) 
can be identified with A + D A - . In particular, ker A is nontrivial if and only if A + R A - ^ 
{0}. 



Further, pick any two curves y± satisfying (33) such that the associated pairs of 



Lagrangian subspaces are transverse. Let u: R 2 — > M be any C 1 -map such that each 



curve 7s(£) = u(s,t) also satisfies (33) and y s — > j± as s — > =Foo in the C 1 -topology. 
With the help of the relative Maslov index for Lagrangian pairs [RSI J we associate with 
the triple (7 + ,7~;m) an integer /i(7 + , 7~; u), which is referred to as the relative Maslov 
index. To define /i(7 + ,7~;w) denote by £(TM) the Lagrangian Grassmannian bundle 
and put /3o(s) = 7 S (0) = u(s, 0). Then we obtain a pair of sections (A + , A~) of the bundle 
(3q£(TM) such that the subspaces A + (s) and A~(s) are transverse for s = ±oo. Choose 
a unitary trivialization of (5qTM and represent A^ 1 by a pair of curves Aj: R — )• £(R 2n ). 
It is said that a crossing, i.e., a point s such that A + (s ) PI A~(s ) ^ 0, is regular if the 
associated crossing form |RSlj T(A + , A", s ) : A + (s ) PI A _ (s ) — > K is nondegenerate. If 
all crossings are regular, then the number 

/i(7 + , 7 -;M) =y u(A+,A ) = Yl signr(A+,A-,s ) GZ 

so is crossing 

does not depend on the choice of the unitary trivialization, i.e. the relative Maslov index 
is well-defined. 



Proposition 2.30. With the same notations as in Theorem 2.28, the index of D U Y, is 
given by 

Ind(D u S) = /i(7 + , 7~; u). 

Proof. We follow the line of argument in [Sal2j. 

Choose a C 1 -small perturbation u of the map u with the following properties: -D^E 
is Fredholm, Ind(D^S) = Ind(D„S), the Lagrangian pairs associated with the curves 
w(±oo,t) are transverse, and there exists T > such that u(s,±t) = m T for all t > T. 



Construct also a unitary trivialization of u*TM as described in Remark 2.16 Write -D^S 
in the form 

L(0 = d s £ + A(s)^ Z:R 2 ^R 2n , 

where A(s)£ = Jod t t; + S(s,i)£. Since the limits of the matrix S(s,t) associated with u 
are symmetric, up to a compact perturbation we can also assume that matrix S(s, t) is 
symmetric for all (s,t). By the choice of u we also have S(s, ±t) = H T for t > T, where 
H T represents the Hessian of Im / at m T . 

Further, denote fi = min{|/x| : ker( JqH± — ji) ^ } > and consider A(s) as an 
unbounded operator in L 2 (IR; R 2n ) with the domain iy 1,2 (IR; M. 2n ). Then for all s G R any 
point of the spectrum of A(s) from the interval (— fi , /x ) is an eigenvalue. Indeed, for any 
(s,fj,) ERx (-/i ,yu ) the operator A(s) - fx: W 1 ' 2 (R; R 2n ) L 2 (R;R 2n ) is Fredholm, 
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since J H±—/j, is nondegenerate. Moreover, lnd(A(s)—fi) = IndA(s) = Ind(— J A(s)) = 
since the indices of — J A(+ oo) and D 1 a coincide. Hence, if \i is not an eigenvalue of 
A(s), then A(s) - fx: W 1 ' 2 ^; R 2n ) ->• L 2 (R;R 2n ) is bijective and therefore /i belongs to 
the resolvent set of A(s). 

From the above observation follows |APSj that the index of L can be computed with 
the help of the spectral flow of A(s). Namely, a point s is said to be a regular crossing 
of the family A(s) if ker A(sq) 7^ and the crossing form 

T(A,s )Z = (Z,(d s A)0 L * = (C,d s S(s ,-)0^, f e ker A(s ) 

is nondegenerate. Then, if A(s) has only regular intersection points, we have: IndL = 
^2 S0 signr(A, So), where the summation runs over all crossings Sq. 

It follows from Remark 2.29 that crossings of (A^Aq) and A(-) coincide. Therefore 
to complete the proof it suffices to show that under the natural identification Aq (s ) PI 
Aq(so) — ker A(so) the associated crossing forms coincide at each crossing s (we can 
assume that only regular crossings occur). 

Let E(s, t) be the solution operator of A(s), i.e., E(s, t) is a square matrix of dimension 
2n satisfying 

J d t E + S(s,t)E = 0, E(s,0) = l. 
Since S(s,t) is symmetric, E(s,t) G Sp(2n;M) for all (s,t). From the equality 

d t (E T J d s E) = -(E T SJ )J d s E + E T J d s (J SE) = -E T d s SE 

we obtain (E£ , d s SE^ ) = ~d t (S£ , Jod s E^ ) = d t uj (E^ , d s E£ ), where £ e R 2n . 
Hence, for any crossing s and any £ G Ag (s ) H Aq(s ) we have: 

/+oo 
(E(s ,t)£o, d.S(s ,t)E(s ,t)£a)dt 
(34) 

= lim w (S(s ,t)fo, d s E(s ,t)£ ) - lim uj (E(s , t)£ , d s E(s , *)&)■ 

t— >+oo v ' t— >-oo v ' 

On the other hand, for £ as above and for all s from a sufficiently small neighbourhood 
of so there exists G A~(so) such that £o + £~( s ) G A + (s), i- e -; 

lim S(s ,t)f(s) = and lim S(s, t)(f + = 0. 

t— >+oo t— >— oo 

For i < — T we must have S(s,i)(£ + = X^7=i c i( s ) eAj *? where Ai,...,A n are 

positive eigenvalues of the matrix JqH + . Hence, d s S(so,i)£o + E(so,t)d s £,~(so) — > as 
i — 7- — oo and this in turn implies 

uo(£o,d s C(s )) = w (E(s ,t)£o,E(so,t)d a C(s )) 

= - lim uj (E(so,t)^ ,d s E(s ,t)^ ). 

Similarly, there also exists £ + (s) G A + (s ) for all s sufficiently close to Sq such that 
£o + £ + ( s ) G A~(s). Arguing as above, wee see that 

uoUo,d s £ + (s )) = - ]im u (E(so,t)£ ,d s E(s ,t)£o). (36) 

v ' t— >+oo v 7 

Since by definition r(A+, A~, s )£o = w (£ , <9 s £~(s )) - w (6, d s £ + (s )) , combining (34)- 
(36) we finally obtain T(A + , A~, sq)£o = T(v4, sq)£o- This finishes the proof. □ 



26 



For any p > 2 consider the space 



B={ue Wf*(R 2 ; M) | 3 R > 0,f± G W^'^TM), and r? ± G W^R 2 ; T m± M) 

s.t. it = exp 7± £± for =p s > R an d M — ex P m± V± f° r T t > Rj. 

One can construct an atlas on B similarly to |Flol Theorem 3]. Thus B is a Banach 
manifold. Observe that for u G B we have T U B = W 1,P (R 2 ; u*TM). 

Let J 7 — > B be the vector bundle with the fiber J- u = L P (IR 2 ; u*TM). Then the map 
S can be interpreted as a section of J 7 . Clearly, any solution of = is a smooth 



map. By Corollary 2.20 the zero locus of £ coincides with .M(7_;7+). Notice also that 



the covariant derivative of S at the point it can be identified with the map 

DJ1: iy 1,p (]R 2 ; u*TM) -> L P (M 2 ; m*TM), 
which is Fredholm. We summarise these observations in the following proposition. 

Proposition 2.31. The zero locus of '£ G T(B;J 7 ) is the space of solutions of (]7])-d9]). 

Moreover, for each zero u the covariant derivative -D n E is Fredholm. 



3 A gauge theory on 5-manifolds 

Let E be a five-dimensional oriented Euclidean vector space with a preferred vector v G E 
of unit norm. Let r/(-) = (v, •) denote the corresponding 1-form. Then the linear map 

T v : A 2 E* — y A 2 E*, io^*(ooAr]) 

has three eigenvalues { — 1,0, +1} and the space A 2 E* decomposes as the direct sum of 
the corresponding eigenspaces: 

A 2 E* ^ A 2 _E* © A 2 £* © A\E*. 

Indeed, denote by H the orthogonal complement of v. Then A 2 E* = A 2 H* © H* and 
one easily checks that the following subspaces A\H* and H* are eigenspaces of T v , where 
A 2 ± H* denote the eigenspaces of the four-dimensional Hodge star operator. In other words, 
A 2 ± E* = A 2 ± H* and A 2 E* = H*. 

Identify the Clifford algebra of E with AE and recall the following description of the 
Clifford multiplication 

CI = CI' + CI", 
c(e © oj) = —i e uj, 



In particular, by restriction we get a map CI': E* © A 2 + E* — > E* , which is essentially 
the four-dimensional homomorphism H* © A 2 + H* — > H*. 

Observe that A 2 + H* has a natural structure of a Lie algebra as a three-dimensional 
oriented Euclidean vector space. For an arbitrary Lie algebra q denote V = A 2 + H* ©0 and 



CI: E* © AE* — > AE*, 
CI': E* © A P E* = E © A P E* A^E*, 
CI": E* © A P E* A P+1 E*. 
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consider the linear map a: V ®V — > V, a — |[- , -] A 2 H * <g) [■ , -] fl . Choosing a Lie algebra 
isomorphism h? + H* = IR 3 , for £ = e x £g> ^ + e 2 © £2 + e 3 ® £3 we obtain 

a{£, = ei ® [6, 6] + e 2 © [£3,6] + e 3 © [fi, 6]- 



Let (VT 5 , g) be an arbitrary oriented Riemannian five-manifold with a preferred vector 
field v of pointwise unit norm. Denote T](-) = g(v, •) G and H = keri] C TW. As 

described above, we have the following splittings: 

n\w) = n\{w) © n°{w)r], n\{w) = r(n*), 
n 2 (w) = n 2 _(w) © nl(w) © n 2 + (w). 

Let P — > W be a principal G-bundle, where G is a compact Lie group. Denote by A(P) 
the space of connections on P and by adP the adjoint bundle of Lie algebras. Consider 
the following equations for a pair (A, B) e A(P) x fi^_(ac?P) = i3: 

^-^ = 

F+ - V? B - <r(B, B) = 0, 
where the operator 8\: Vt 2 + (adP) — >■ Q\(adP) is defined by the composition 

5+: r(A*?T <8>adP) VLC ' A > r(T¥®A^*®a(iP) > T(W®adP). 

Here V LC,A denotes the tensor product of A and the connection on A+H* induced by 
the Levi-Civita connection (we do not assume that K 2 + 1-L* is preserved by the Levi-Civita 
connection). It is convenient to define a map $: B — > Q\(adP) x Vt\(adP) by the left 



hand side of equations (37). 



Remark 3.1. Equations (37) were independently discovered by Witten |Wit3j from a 



different perspective. A partial case with B = has been studied by Fan |Fan] . 

Remark 3.2. The total space of K 2 + l-i — > W is an eight-manifold equipped with a natural 
5'pm(7)-structure, which is induced by the Riemannian metric and orientation on W. 
This Spm(7)-structure can be constructed using the technique of |BS] . Then, following 
the line of argument in |Hay], one can show that solutions of equations (37) correspond 
to Spm(7)-instantons on K 2 + l-L invariant along each fibre. 

The gauge group G(P) acts on the configuration space B on the right 

(A,B)-g = (A-g, ad g -iB), geG(P), 

where g acts on the first component by the usual gauge transformation. The infinitesimal 
action at a point (A, B) is given by the map 

K-.n°(adP) — >n 1 (adP)@n 2 + (adP), £ ■->• (d A £, [B,£]). 

Notice also that the map $ is (J(P)-equivariant. 
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The standard computation yields 
5$ 



'(A,B) 



i v (dAOi) — o~a/3 + a ■ B 
d\a [a(v),B] - 2a{B, (3) 



(a, 0) G T ( a,b)B, 



where the term a ■ B G Q^adP) is constructed algebraically from a and B, namely 
a ■ B = CV <g> [• , -] b (q! ® B). Thus we get the deformation complex at the point (A, B): 



-> Q°{adP) n x {adP) © ft^(adP) Sl\(adP) ® Q 2 + {adP) -» 0. 



(5* 



(3* 



Lemma 3.3. Deformation complex (38) is elliptic. 



The statement of this Lemma follows immediately from Remark 3J2 Alternatively, 
one can consider equations (37) on IR 5 and show that the symbol of K* + 5$ is modelled 
on the octonionic multiplication. We omit the details. 



4 Dimensional reductions 



Before turning our attention to the dimensional reductions of equations (37) a little di- 
gression is in place. Suppose a Lie group Q acts freely and isometrically on a Riemannian 
manifold M. Identify a ^-invariant function /: M — > R with a function /: M/Q — > IR. 
Then critical points of / correspond to orbits of solutions of the equation grad/ = K^, 
where £ G Lie(Q) and K$ is the Killing vector field corresponding to £. But the invariance 
of / implies (grad/, Kg) = for any £' G Lie(Q) so that we necessarily have grad/ = 
for any point on M projecting to a critical point of /. 

Similarly, a curve m : R — > M projects to an antigradient flow of / if and only if there 
exists £: IR — > Lie(Q) such that 



m 



-grad f + Kg (39) 



The Lie group {g : R — > Q} acts on solutions of equation (39 ) and the orbits are in bijective 
correspondence with the antigradient flow lines of /. Furthermore, we may consider only 
those solutions, which are horizontal with respect to the natural connection. This gives a 
bijection between ordinary flow lines of / modulo Q and flow lines of /. 



The upshot is that ^-invariance of / implies that equation (39) is equivalent to the 
ordinary antigradient flow equation of /. It will be important to switch freely between 
these two approaches in an infinite-dimensional setup. The reasons will be clear below. 

4.1 Dimension four 



Let X be a closed oriented Riemannian four-manifold. Below we consider equations (37) 
on (W,v) = (X x R t , J^) endowed with the product metric. 

Denote by pr: X x IR — > X the canonical projection and set P = pr*Px, where 
P x — > X is a principal G-bundle. Think of B G £l 2 + (X x IR; pr*adP x ) as a map b: IR — > 
Vt 2 + {X;adP x )- Similarly A G A(pr*P x ) can be seen as a map (a, c) : IR — > A(P X ) x 



Q°(adP x ), where c is the Higgs field. Then equations (37) are easily seen to become 

a = 5tb + d a c, 

(40) 

b = F+-a(b,b)-[c,b], 
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where 5+ = (d + )*. These equations turn out to be the antigradient flow equations of some 
function. Indeed, consider the function 

h: A 2 + H* <g> g -> R, h(w) = -(w, <r(w)). 

3 

Choose an isomorphism A^P* = IR 3 and write w = X^=i e « ® £«• Then we have Tt(w) = 
(£i> [£2, £3]) and therefore grad/i(w) = cr(w). Since /i is equivariant with respect to both 
SO (3) and G, we obtain a well-defined map f2^(a<iPx) — * C°°(X) denoted by the same 
letter. 

Denote B = A(P) x Vt 2 + (ad P) / Q (P) . As usual, B* C B denotes the quotient space of 
irreducible points. The negative L 2 -gradient of the function 



U:B^R, U(a,b) 



■(F+,b) L 2+ ! h(b)vol x 
Jx 



is (S^b, — a(b, b)). Hence, assuming there are no reducible solutions, equations (40) 
represent the antigradient flow equations of the function U : B* — >■ R. 
We summarize our computations in the following proposition. 



Proposition 4.1. If there are no reducible solutions, equations (40) represent antigradient 
flow equations of the function U : B* — > IR. □ 

The critical points of the function U are solutions of the Vafa-Witten equations jVW] : 

5+b + d a c = 0, 
F+-a(b,b) + [b,c] = 0. 

These equations are elliptic and the expected dimension of the moduli space is zero. 

As we have seen, the Q (P)-invariance of U implies that for each irreducible solution 
of the Vafa-Witten equations we have (d a c, [b,c]) = 0, i.e. in the absence of reducible 
solutions the above equations are equivalent to 



(41) 



Kb = 0, 

F+-a(b,b)=0. 
Notice that the Weitzenbock formula 

2<W = (VTV a -2W + + S -+ a(F+, ■), 

yields 

4IIC&II 2 + ll^ + " '{b, b)\\ 2 = 2\\V%\\ 2 - 4(W + (b), b) + |< a &, b) + 2<F+, a(b, b)) 

+ ||F a + || 2 + lk(&,6)|| 2 -2(F+ )( 7(6,6)) 
= 2\\V a b\\ 2 -4(W + (b),b) + 2 -{sb,b) + ||F a +|| 2 + \\<r(b, b) || 2 . 

Proposition 4.2 ( (VWj ). If the operator —W + + is pointwise non-negative definite on 
K 2 + T*X, then for any irreducible solution (a,b) of the Vafa-Witten equations the following 
holds: F+ = 0, V a b = 0. □ 
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4.2 Dimension three 



In this section various forms of equations (37) are studied on Y 3 x R 2 , where Y is a closed 
oriented Riemannian three-manifold. 



Just like in the instanton Floer theory, consider solutions of (41) on X = Y x R. 
Assuming a is in a temporal gauge, we obtain the following system of equations 

a = -*(F a -i[6A6]), 

b = *d a b, (42) 
= 5 a b, 

where (a, b) is interpreted as a curve in A(P) x Q l (adP) = T*A(P). Here we have also 
used the isomorphism r(7r*T*F) = fi^Yxl), uj h-» ±(* 3 u + ds Au), where vr: Y xR -> Y 
is the projection. 

Observe that T*A(P) is a (flat) Kahler manifold and the action of the gauge group is 
Hamiltonian. The momentum map is given by 

fi: T*A(P) n°(adP), /i(a,b) = 5 a b. (43) 

Denote N = /i _1 (0) = {(a, b) \ 5 a b = 0} C T*A(P). It follows from the very definition 
of the momentum map that d\i is surjective at (a, b) if and only if the gauge group acts 
locally freely at (a,b). Therefore, the subset N* consisting of all irreducible points of A" 
is a submanifold. Hence, N*/Q(P) is a Kahler manifold. 
Consider the map 

/ : A{P) x Vl^adP) R/Z, /o(a,6) = 87r¥(a) - \{b, *d a b) L 2, 

where d is the Chern-Simons function. It is easy to check that the vector field grad /o = 
(*(F a — \ [b A b}) , — * d a b) is tangent to A^* at each point. Therefore critical points of the 
restriction of fo to A^* are solutions of Hitchin's equation^] [Hit] : 

F a -l\bAb] = 0, 

d a b = 0, (44) 
S a b = 0. 



More accurately, in the same manner as described at the beginning of this section, orbits of 



irreducible solutions to (44) correspond to critical points of fo'- N*/Q(P) — > R. Similarly, 



orbits of (42) correspond to the flow lines of Jo- 



Remark 4.3. Denote by G c the complexified Lie group and by V = Px G G c the principal 
G c -bundle associated with P. Any connection on V can be written in the form A = a + ib, 
where (a, b) G A(P) x Q 1 (adP). Conversely, any pair (a, b) combines to a G c connection 



A. Then A is flat if and only if the first two equations of (44) are satisfied. The last 



equation, i.e. the vanishing of the moment map, has been analyzed in |Donlt ICorj . 
Remark 4.4. Hitchin's equations can be obtained from SU(3) anti-self-duality equations 



along similar lines to those outlined in Remark 3/2 Namely, the total space of T*Y is 
equipped with an S'?7(3)-structure. Then S"?7(3)-instantons invariant along each fiber are 
solutions of Hitchin's equations. 



5 Hitchin studied these equations in the case of two-dimensional base manifolds. 
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We can also consider equations (37) on W = WL t x Y x K s with v = — Write 



A = a + eds + cdt, where a is a family of connections on P — > Y . Consider first only 
t-invariant solutions with c = e = 0. A computation yields the following system: 

a = — *d a b, 

6 = -*(F.-i[6A6]), (45) 
= 5 a b, 



where the dots denote the derivative with respect to the variable s. Equations (45) 



and (42) appeared in |KW] for the first time and were further studied in [Witl! IWit2] . 



Consider the function 



ft : T*A(P) -> R, f\(a, b) = (F a , *b) L , - J h(b) voly. 
Since grad/i = (*d a b, *(F a — |[6 A b])) is tangent to N* at each point we conclude 



that the moduli of solutions to equations (45) correspond to antigradient flow lines of 
ft: N*/g(P) R. 

Let us examine the functions fo and fi more closely. Since grad fi = Jgrad fo, where J 
is the constant complex structure on T*A(P) = Q 1 (ad P)<gsC, we obtain that the function 
f = fo + ifi is J- ho lo morphia Writing (a, b) as a G c -connection A as in Remark 4.3 it is 
easy to check that / is the complex Chern-Simons functional 

CS(A) = 1 [ ({A A dA) + l(A A [A A A])) . 
2 Jy 

Here we interpret A as a valued 1-form on Y, and (-,-): 0c ® 0c ~ ^ C denotes the 
C-linear extension of the scalar product on 0. 



Further, let us consider equations (37) on (W, v ) = (Y x R 2 st ,j^). The standard 
reduction procedure yields the following system 

d s a - d t b + [b, c] - d a e + * (F a - |[6 A 6]) = 0, 

d t a + d s b - [b, e] - d a c - *d a b = 0, (46) 

d t e — d s c + [c, e] + 5 a b = 0. 

Here a is a connection on the pull-back of P = Py to Y x R 2 , b is a 1-form and c, e are 
0-forms with values in the adjoint bundle of Lie algebras. It is easy to check that these 
equations are symplectic vortex equations |CGSj with a Hamiltonian perturbation for the 
following data: The target space is T*A(P) equipped with the Hamiltonian action of the 
gauge group G(P), u = (a, b) : 1R 2 — > T*A(P), A = eds + cdt, and the perturbation is 
a = |lm (fdz) = |(,/b dt + fi ds). 

Notice also that we are free to rotate the coordinates s and t or, equivalently, to rotate 
the initial vector field v = dt- This is in turn equivalent to the choice of the Hamiltonian 
perturbation o = |lm (e ld fdz) and the resulting equations are 

d s a — d t b + [b, c] — d a e — s'm8 *d a b + cos6> * (F a — |[6 A b]) = 0, 

dta + d s b - [b, e] - d a c - cos 9 *d a b- sin 6 * (F a - \ [b A b}) = 0, (47) 

d t e - d s c + [c, e] + 5 a b = 0. 
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Remark 4.5. The above description of equations (47) is analogous to the interpretation 
of the anti-self-duality equations on C x £ as symplectic vortex equations |CGSj . A new 
phenomenon here is the appearance of the Hamiltonian perturbation. Notice also that 
the adiabatic limit procedure as in |CGS} IGS] for equations (47) yields (at least formally) 
holomorphic planes to T*A(P)//Q(P) with a Hamiltonian perturbation. 



For solutions of equations (47) invariant with respect to s we obtain the following 

system 

a = cos9 *d a b + sin8 * (F a — |[6 A b]) + d a c + [b, e], 

b= -sin9 *d a b + cos9 *(F a - \[b Afo]) -d a e+[b,c], (48) 

e = -5 a b+ [e, c]. 

Notice that if c = e = we obtain equations (42) and (45) for 9 = —tt/2 and 6 = ir, 
respectively. 

It will be helpful in the sequel to consider equations (48) from a more abstract point 
of view. Namely, let (M, u) be a symplectic manifold. Assume a Lie group Q acts on M 
in a Hamiltonian manner. Denote by fi: M — > (3 = Lie(Q) the corresponding moment 
map. Let / : M — > C be a (/-invariant J-holomorphic function, where J is a ^-invariant 
almost complex structure on M. Consider the following equations for a curve (7, £, if) in 
1x0x6: 



7 = sin6»grad/ (7) + cos6»grad/i(7) + ^(7) - JK v (j), 

v = - [£,v], 



(49) 



where K is the Killing vector field. Clearly, we obtain equations (48) from (49) putting 
M = T*A(P). 

Further, observe that for any (,p 6 the following equalities hold: 

d(u(K K p )) = di Kp (i Kc uj) = £ Kp (t Kc uj) - t Kp d(t Kc u) = ik [Pi<] u = -d(fi, [C,p]}- 

Here the second equality follows from Cartan's equation. Hence, (/x, [£, p\) = —u(K^, K p ) = 
g{K^, JK p ). Therefore for any solution of (49) we have 

^0(7), ??) = w(tf„,7) + CM) = g(JK v ,Kz) - g(JK v ,JK v ) - (ji,fi) - (/i, [£,77]) 

= -g(K v ,K r ,)-(fi, f i)<0. 

Here the first equality follows from the definition of the momentum map, the second 
one from equations (49) and the ^-invariance of /, and the last one from the equation 
(fi, [£,77]) = g(K^, JK V ). Hence, for any solution of equations (49) the function (7/(7), 77) 
is non-increasing. 

We will be interested below in solutions (7, £,77) of (49) satisfying the condition 

— > (m±,0,0) as t ->■ Too, (51) 

where m± are critical points of /. For any such solution (7^(7), 77) vanishes at ±00 and 
hence vanishes everywhere. Then from (50 ) we conclude that 77 and 7x07 vanish everywhere, 
i.e. under condition (51) equations (49) reduce to 

7 = sin 6 grad fo + cos 9 grad fi + fQ, 7/(7) = 0. 
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From the discussion at the beginning of Section [4] we obtain that these equations are 
equivalent to 

7 = sin 9 grad fo + cos 9 grad f\, ^(7) = 0. (52) 



Summing up, we have that under condition (51) systems (49) and (52) are equivalent. 
Applying this conclusion in the case M = T*A(P) we obtain that for 9 = —n/2 equa- 



tions (48) together with the condition 



(a,b,c,e) — > (a±,b±,0,0) as t — > ±00, 



where (a±,b±) are solutions of Hitchin's equations, are equivalent to equations (42) to- 



gether with (a, b) — > (a±,&±) as t — > =Foo. The upshot is that while equations (42) 
and (48) with 9 = —tt/2 are essentially equivalent, only the latter are elliptic. 



Remark 4.6. One obtains an elliptic form of Hitchin's equations on a three manifold 
by considering solutions of equations (37) on (Y x 18L 2 ,d t ) invariant along IR 2 . The corre- 



sponding equations are easily obtained from (46). 



5 Invariants 

In this section we outline constructions of invariants assigned to five-, four-, and three- 
manifolds arising from gauge theories described in the preceding sections. It is clear 
that the constructions described below need an appropriate analytic justification. We 
postpone this to subsequent papers and restrict ourselves to some examples. Throughout 
this section the coefficient ring is Z/2Z in all constructions for the sake of simplicity. 



The expected dimension of the moduli space of solutions of equations (37) for closed 
five-manifolds is zero. Therefore, assuming compactness and transversality, an algebraic 
count associates a number to closed five- manifolds. More accurately, this number depends 
on the isomorphism class of P and on the class of the vector field v in tt (Xq(W)) , where 
X (W) denotes the space of all vector fields on W without zeros. 

Let us now consider the dimension four. The corresponding construction is very similar 
to the instanton Floer theory, so we are very brief here. Assume the moduli space of 
solutions to the Vafa-Witten equations Aiyw is compact and zero-dimensional (for the 
case dimA^vvi/ > see example below). The index of the Hessian on X A x S 1 vanishes 
and therefore the relative Morse index of a pair of critical points is an integerr] The 
Floer differential counts the moduli space of finite-energy solutions of equations ( |37| ) on 
X x R converging to solutions of the Vafa-Witten equations at ±00. As a result, for a 
smooth four-manifold equipped with a principal G-bundle Floer-type homology groups 
can conjecturally be constructed. 

Example 5.1. Let X be a Kahler surface with a non-negative scalar curvature. Then 



Proposition |4.2| applies and, therefore, Aiyw = -Masd assuming all asd connections are 
irreducible and non-degenerate. If dimA^ as d > the function U is not Morse but rather 
Morse-Bott. Then choosing a suitable perturbation, which is essentially a Morse function 



4 In general, there is no a distinguished critical point as in the S'J7(2)-instanton Floer theory, so that 
we are left with the relative grading only. 
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h on Ai as d, one obtains the Morse-Witten complex of h. The details can be found for 
instance in |BH] . In other words, the corresponding Floer homology groups are homology 
groups of J\A as d- Notice that this agrees perfectly with the Vafa-Witten theory: The 
Vafa-Witten invariant, which counts solutions of the Vafa-Witten equations, is the Euler 
characteristic of M. as d provided the only solutions of the Vafa-Witten equations are anti- 
self-dual instantons. 

It is worth pointing out that the above reasoning is valid if M. as d admits a compact- 
ification, which is a manifold. Notice that the Euler characteristic of M. a sd in |VW] is 
taken as the Euler characteristic of the Gieseker compactification. 



Further, let us consider dimension three. Let (Y, g) be a closed oriented Riemannian 
three-manifold. Pick a nontrivial principal G-bundle P — > Y and assume that all solutions 
of Hitchin's equations are irreducible (thus we exclude the case G = SU(2)) and the 
moduli space is finite, say {A\, . . . ,Ak}- Recall that this is the critical set of the complex 
Chern-Simons functional and therefore we can conjecturally construct a corresponding 
collection of k Fukaya-Seidel Aoo-categorie^] A,(V) as described in Section 2.2 



Thus, the objects of Aj(Y) are classes of solutions Ai of Hitchin's equations. For 
ease of exposition we assume that ReCS(yii) < ■■■ < ReCS(.Afc), where ReCS(yb) is 
understood to take values in [0, 1). Recall that for any pair A-± £ {^/l^, . . . , ^/L^j*, A,— *C 
the space hom(A-,A + ) is generated by the broken flow lines of the complex Chern- 
Simons functional connecting A^ with A + . More precisely, as described in Remark 2.3 



we 



consider only those broken flow lines 7 for which the image of CS°7 does not intersect the 
set (Re CS(Aj), Re CS(A, + i)) x K. Recall also that the flow lines of the complex Chern- 



Simons functional can conveniently be described as moduli of solutions of equations (48) 
satisfying the asymptotic conditions 



(a, 6, c, e) 



i°, 6°, 0,0) 



as t — > Too, 



(53) 



where (a±,b±) are solutions of Hitchin's equations representing A±. 

Further, the Floer differential /i 1 : hom(A^, A + ) — > hom(A_,A + ) is obtained by count- 
ing moduli of finite-energy pseudoholomorphic planes with a Hamiltonian perturbation 



satisfying suitable conditions at infinity. In our case, by Remark 4.5 these pseudoholo- 



morphic planes can (formally) be interpreted as solutions of equations (47), which are in 
turn interpreted as solutions of equations (37) on W = Y x 1R 2 . 



Summing up, choose any admissible pair S ± of gauge equivalence classes of finite- 



energy solutions of equations (48) and (53). Then define the map fi 1 by counting moduli 
of solutions to equations (37) on (W,v) = (Y x M. 2 ,cos8dt + sin#<9 s ) with the following 
boundary conditions 



a,b,c,e) —> (a±(t), b±(t), 0, 0) 
0,0) 



(a,6,c,e) (a° ± ,b° ± , 



as 
as 



s — > =Foo, 
t — > Too, 



where (a±(t),b±(t)) represents the class !B ± . 

To define the map fi 2 , one considers finite-energy solutions of equations ( |37| ) on W = 
Y x Vl satisfying appropriate boundary conditions, where £1 is as shown in FigjlJ The maps 



^Aj{Y) will also depend on the metric as well as on the choice of P. 
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Ii d for d > 3 are defined similarly and conjecturally the whole collection {fi d } combines 
to an Aoo-structure. 

Notice that the change of orientation on Y is equivalent to multiplication of / by — 1 
and hence does not affect Aj(Y). On the other hand, Aj(Y) depends on the Riemannian 
metric g. However, as explained in |Seilj the derived category D b (Aj(Y)) should be 
independent of g. 



A Pseudoholomorphic strips and pseudoholomorphic 
planes 

In this appendix we outline (without proof) a connection between pseudoholomorphic 
planes with a Hamiltonian perturbation and pseudoholomorphic strips with Lagrangian 
boundary conditions. To do so, pick a pair (m_,m + ) of critical points of / and assume 
that the interval z_z + does not contain any other critical point, where z± = f{m±). It 
is convenient to choose the midpoint of the basepoint. We deviate here from our 

convention on the choice of the basepoint for the convenience of exposition only, namely 
to avoid differential equations with non-smooth coefficients. 

Replacing / with e~ l9± (f — zq) if necessary we may assume that z± = ±T, T > and 
hence zq = 0,9 (t) = 0. We establish a relation between solutions of the equations 



d s u + J(d t u + v ) = 0, it: 



lim u(s, t) = m=r, 

t->±oo V ' + 



lim u(s,t) = 7 T (t) 

s— >±oo 



(54) 



and pseudoholomorphic strips in two steps. In the first step we relate solutions of equa- 

r r n j =0, (s,r)ERx(-T,T), 



tions (54) to solutions of the problem 

1 



d s u + J (d T UQ + 
u (s, ±T) = m T , 



\ v o\ 



where 70, ± satisfies the equations 



d 



dr 7 ° + 
7o (±T) 



m 



lim u (s,t) = 7o,±(t) 

s— >±oo 



r t, = , r e (— T, T), 



(55) 



(56) 



In the second step we show how to relate solutions of (55) to pseudoholomorphic strips 



Step 1. It is an elementary fact that equations (56) are equivalent to the antigradient 



flow equations for /q. Nevertheless it is instructive to examine this equivalence more 
closely. Consider the family of equations 



7a + 



1 



A + (1-A)|KI 

lim j x {t) = m T , 
t— ¥±00 



v = 0, 



7a- 



->• M, 



(57) 
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where A G (0,1], and fix a parametrization by the condition f ° 7a(0) = 0. Pick any 
solution 7x of equations (57) for A = 1, i.e. an antigradient flow line of f , and consider 



the following family of diffeomorphisms 



— >• 



r A (t) = At +(l-A)/ ° 7i (*), AG (0,1]. 



It is straightforward to check that 7a = 71 °t a 1 is a solution of (57), and this establishes a 



bijection between antigradient flow lines of /o an d solutions of (57). This correspondence 



is also valid for A = 0, but in this case r maps IR bijectively onto the interval (— T, T). If 
we extend 70 by the constant values outside (— T, T), then 7a converges to 70 in C°(M; M) 
as A (in fact, in any reasonable topology). 

With this understood, consider the family of equations 



d s ii\ + j(d t u x + 



v 



0. 



lim u\(s,t) 

t— >-±oo 



A + (1-A)K| 
m T , lim u x (s,t) = j x ,±(t). 

s— >±oo 



(M) e 



(5f 



For these equations explicit correspondence between solutions for different values of A 
is not available anymore, but it is reasonable to expect that u\ converges to a solution 



of (55) as A 0. 



Step 2. Let L±(t) C / 1 (r), r G (-T, T), denote the vanishing cycle of m± associated 
with the segment [r, ±T]. Consider the family of equations 



dsUp + J [dtu^ + 



u M (s,±T) GL ± (±(l-/x)T), 



1-/i 
n — ii^o 



0. 



s,r G 



lim tfy(s,r) 

s— >±oo 



(— T, T) 
7o,±((1-^)t) 



with /1 G [0, 1]. Clearly, for /x = we obtain equations (55), whereas for /x = 1 we have 



holomorphic strips as in the classical definition of the Floer differential. Notice that the 
images of such holomorphic strips lie in the fiber of /. 



Remark A.l. Pick a solution uq of equations (55) and denote f °uq = ip + itft. It follows 



from the holomorphicity of / that and ip satisfy the inhomogeneous Cauchy-Riemann 
equations 

d s cp — d T ijj = 0, d s tp + d T (p + 1 = 

and therefore both functions are harmonic. Moreover, the holomorphicity of / also implies 
that fi ° 7±(t) is constant it r and therefore vanishes everywhere, since f\ ° 7±(±T) = 
fi(m±) = 0. We conclude that ip vanishes as r — > ±T and as s 4 ±00 and thus 
vanishes everywhere. Therefore (p(s, r) = — r. We see that unlike pseudoholomorphic 



strips, images of solutions of (55) do not lie in a fixed fiber of /, but rather the fiber of 



Uq(s, t) varies in a controlled manner for any u . 



Notice also that at the first glance equation (55) has singularities. Namely, if a solution 



Mo hits a critical point of / at a single point (so,tq), then ip and ip are harmonic in 
R x (— T, T) \ {(so,To)} and continuous at (so,t ). Hence the singularity is removable 
and the above argument shows that the image of / ° Uq is the segment (— T, T). Since by 
assumption the segment (— T, T) does not contain any critical values, we conclude that a 



priori a solution of (55) cannot hit a critical point of / in an interior point. 
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B On broken flow lines 



In this appendix missing details on broken flow lines are provided. We use notations 
introduced in Subsections 12.21 and 12.31 

Lemma B.l. Suppose the closed domain G bounded by the triangle z^zqz + contains no 
critical values of f other than z± . Denote by £ the curve Z-Zo U z$z + . Then for any e > 
there exists Uq > such that for all broken flow lines 7^ of f connecting m_ and m + and 
allt el we have 

d(fo 7„(t), tj < e provided v < z/ . (59) 

Proof. The lemma is proved in three steps. 

Step 1. For any broken flow line ^ v the image of the curve f 07^: R — > C is contained 
in G. 

From ^ we have ^lui/ o ^(t) = — sm9 u (t)p o 7^ < for t < 0. Since lim 4 _ 5l _ 00 / o 
^vif) = z + we conclude that Im/o7„(t) < Imz + = ( for all t < 0. Similarly, Im fo^ v {t) < 
Imz_ = C, for all t > 0. Hence, the image of the curve / 07^ lies in the half-plane, which 
is bounded by the straight line through z_ and z + and contains z . Arguing along similar 
lines, one also obtains that the image of / o 7^ is contained in the half-plane bounded by 
the straight line through z± and z and containing z T . 

Step 2. For any e > there exist T E > and vq = vq{e) > such that f ° / ~f u (±t) G 
B £ (z T ) for all t >T £ and all v < uq. 

We prove that / ° r y u (t) G B £ (zJ) for all t > T £ and all v < z/ . The rest can be proved 
similarly. 

For an arbitrary e > denote 

Pe — inf{p(m) I f{m) G G, Im/(m) < ( — e} > 0, 

T £ = l + ^^-, u = T/ 
p £ sm U_ 



We claim that Im / ° 7i/(T e ) > ( — e for any < z/ . Indeed, assume this is not the case, 
i.e. there exists v < vq such that Im / ° 7i,(T e ) < £ — e. Then for any t G [1, T e ] we have 
Im / o 7 Jy (t) < C — e since the function Im / ° 7l/ (£) is monotone for t > as indicated in 
the proof of Step [T] Hence, 

C>Im(/o 7 ,(T £ )-/o 7 ,(l)) =sm0-J° po>y v (t)dt>smO-p e {T e -l) > 1 + (. 

This contradiction proves the inequality Im / o 7^(T e ) > £ — e, which in turn implies 
that Im / o 7^(t) > £ — e for all t > T £ and all v < v§. Arguing along similar lines and 
redenoting T £ , v§ if necessary one also obtains that the inequality Im (e~ l8+ f 7i/(/)) > 
Re [e~ %B+ zJ) — e holds for all t >T £ and all v < uq. This implies Step 

Step 3. We prove the lemma. 

Pick any e > 0. Then by Step [2] there exist T £ > and v < T~ x such that |/ o 
7„(i) — z\< e holds for all t >T £ provided v < v . Since for t G [u, u^ 1 ] we have that 
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foj v (t) lies on a straight line parallel to the straight line through z Q and z_, we obtain that 
inequality (59) holds for all t > v. Using similar arguments one shows that inequality (59) 
also holds for t < —v. Furthermore, the length of the curve / o j v (t), t G [— u, u], is 
bounded by 2*Jpv, where p = sup{p(m) | m G M}. Redenoting z/ if necessary we obtain 
that inequality (59) holds for t G [—u, u] as well. □ 



Proof of Proposition 2-4 ■ The proof consists of the following four steps 

Step 1. For any e > there exists Uq > such that d( r y v (t),m-) < e for all v < 
vo, t > v~ x + 1, and 7^ G r^(m_, m+). 

From the equality ^Re (/ ° 7i,(t)) = 
obtain 

/•oo 

\Ut)\ 2 dt = Re(fo lu (u- 1 + l)) 



\ A fiy{t)\ 2 , which is valid for all t > v 
Re z_ 



-1 + 1, we 
(60) 



Hence, the map /3 u (t) = 7^(z/~ 1 +1 + belongs to W 1 ' 2 (R + ;M). Moreover, by Step g 
in the proof of Lemma B.l there exists z/ — Vq(e) such that ||/? I ,|| w -i,2 < e for all i/ < u . 



Hence, Step |T| follows from the Sobolev embedding W 1 ' 2 (R + ; M) m> C°(R+; M). 

5^ep 2. For any e > i/iere exzsfo z/ = fo(^) > such that \j u (t)\ < e for all 
v < i^o, £ G [z/ -1 , + 1], and 7^ G r jy (m_, m + ). 

By choosing local coordinates we can identify a neighbourhood of m_ with IR 2r \ Since 
m_ is a nondegenerate critical point of f = Re/, we can assume that f is a quadratic 
function in the local representation. Hence there exist positive constants C and 5 such 



that the inequality p(x) < C 2 \x\ 2 holds whenever |x| < 5. Here 
Euclidean norm on IR 2n . Hence, 

\iA 2 = P {iu)<c 2 \ lu \ 2 

provided Yy v \ < 5. Therefore, for any r > we have 



is the standard 



(61) 



+r) 



\luiv- 1 + 1) 



< \lu{v~' + 1 



iv{t) dt\ 



c 



(62) 



\lu{t)\dt 



provided \ j v (t)\ < 5 for all t G [v' 1 + r, v' 1 + 1]. 

For any e > such that e/C < 5 by Step [T] we can choose z/ > so small that the 
inequality 



-i 



< 



e"°e 



C 



< S 



holds for all v < Vq and 7„ G r^(m_,m + ). In particular, (62) holds for all r sufficiently 
close to 1. By the Gronwall-Bellman inequality we obtain 



Mv- 1 + r)\< \ lv {v~ x + r)\e c ^ < e/C 



(63) 



for all r G [0, 1] sufficiently close to 1. This implies in fact that (63) holds for all r G [0, 1]. 
Then Step [2] follows by . 
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Step 3. For any e > there exists T £ > and u < T £ 1 such that d(j u (t),m_) < e 
for all v < i/ , t > T £ , and j u G T v (m_,m + ) . 

Let T £ be as in Step-in the proof of Lemma B.l From the equality J; Re {e~ ie ~ f ° 7„(t)) 
|7^(t)| 2 , which is valid for all t G [i/, v~ x ], we obtain 



7,(0I 3 *= Re(e i0 -/o 7l/ (^)) -Re(e i0 -/o 7l/ (T e )) 



< 2e 



By (60) and Step 2 we obtain 



\%\ dt — | 7 „| + 
/■ : •//: 

< 2e + e 2 + e. 



2 J + , / I • |2 



7„|^t + / \jv\ z dt 



Step g follows from the embedding W^ 2 (R + ; M) m> C°(M+; M). 
S^ep ^. VKe prove the proposition. 

Since p is bounded on M, we obtain that | 7 j| 2 < supp < oo. Then with the help 
of the Ascoli-Arzela theorem we can find a subsequence jj k , which converges to some 
7o G C°(R; M) on each compact interval. Then 7o G C 1 (1R \ {0}; M) and satisfies 7 o + 
cos 6*0^0 + sin^ofi = 0. By Lemma B.l the image of / ° 7 o is contained in I = Z-Z$z + . 
Hence, the limit lim^-too 7 o (t) must be a critical point of the vector field cos 8 T v o+sin 6 T Vi. 
Hence, lim^-too 7o (t) = m T , i.e. 7o is a solution of 

Choose any e > sufficiently small. By Step [3] there exist T £ > and N £ > such 



that 



(64) 



provided t > T £ and k > N £ . Arguing similarly, we also obtain that (64) holds for t < —T t 



(possibly after increasing T £ ). Since 7 j fc converges on [—T £ ,T £ ] we can find N' e > N £ such 
that (64) also holds for t G [—T £ ,T £ ] provided jk > N' e . This finishes the proof. □ 



Introduce the Banach manifold 



l;M) | lim j(t) = m T } 

t— >±oo 



and the vector bundle £ — >■ H 7 ^' 2 , whose fiber at 7 is the Hilbert space L 2 ( 7 *TM). The 



map a v given by (22) can be interpreted as a section of £. Similarly, the map (23) can be 



interpreted as the covariant derivative of o~ v . Then a v is a Fredholm section |Sallj with 
vanishing index, since the Morse indices of m + and m_ are equal. Here m± is regarded 
as a critical point of Re/. Clearly, o"~ 1 (0) = r y (m_;m + ). 

Lemma B.2. Let L± be the vanishing cycle corresponding to the segment z±Zq. If L + 
and L_ intersect transversely in f~ l (0), then there exists u > such that a v intersects 
the zero section transversely for all v G (0,z/o). Moreover there exists a natural bijective 
correspondence between r y (m_;m + ) and To(m^;m + ) provided v G (0,z/q). 
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Proof. Let U + denote the unstable manifold of m + regarded as a critical point of Re (e~ te+ /). 
Similarly, let 5_ denote the stable manifold of m_ regarded as a critical point of Re (e~ l9 ~ /). 

Pick a point m G L_ fl L + = 5_ fl W + and observe that 5_ and U+ are the Lagrangian 
thimbles of m_ and m + associated with the segments z~qzZ and ZqZ+, respectively. Here 
zq is the origin. Then the hypothesis of the lemma implies that S- and U + intersect 
transversally at m. 

Let 70 be the solution of (pj) corresponding to m. Denote by D J0 a the linearization 
of (To at 7o. As we have already remarked above, D 1o o-q \ W x ' 2 {^qTM) — > L 2 {^qTM) is a 
Fredholm operator of index 0. Moreover, it can be shown in the similar manner as in the 
proof of Theorem 3.3 in [Sail] that dimcoker D l0 a = codim(T m 5_ + T m U+). Therefore 
dimcoker D 70 o" = and hence dimker D 10 a = 0. Thus we conclude that cr intersects 
the zero-section transversely. 



It follows from Proposition 2.4 that there exists uq > such that each solution of 
the equation (J v {lv) — 0, v G (0, Vq) is contained in a C°-neighbourhood U^q) of some 
7o G cr ' 1 (0). Notice that the linearization of o~ v at 7^ can be written in the form 

D-Y V a v(Q = Vj u £, + cos^V^Uo + sin^V^i 

= cos^(V^ - V„ £) + sin^(V^i - V Vl £). 

where £ G W 1,2 (7*TM). Hence, redenoting z/ if necessary, we can assume that the 
linearization of a u is non-degenerate at each 7^ G r jy (m_;m + ) contained in |J 7o U(j ) 
for v G (0,z/ ), since #a " 1 (0) = fl L + < 00. Thus a u intersects the zero-section 
transversely provided v < u . 

Consider section of 7r*£, where 7r: W^ 2 . m x IR„ — > M u is the canonical projec- 

tion. Then a v is continuous and satisfies the hypothesis of the implicit function theorem. 
Therefore, {(7, | 07(7) = 0, v G [0, z/ )} is homeomorphic to cr " 1 (0) x [0,z/ ). This 
establishes the bijective correspondence between Po(m_;m + ) and r^(m_;m + ). □ 

Corollary B.3. If L + and L_ intersect transversely in / _1 (0), then there exists u > 
such that hypothesis (tfM holds provided v < Uq. 
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